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■ The Glauber dynamics of disordered spin models with multi-spin interactions on sparse random 

' graphs (Bethe lattices) is investigated. Such models undergo a dynamical glass transition upon 

' decreasing the temperature or increasing the degree of constrainedness. Our analysis is based upon 

a detailed study of large scale rearrangements which control the slow dynamics of the system close to 
^ • the dynamical transition. Particular attention is devoted to the neighborhood of a zero temperature 

^ ' tricritical point. 

, Both the approach and several key results are conjectured to be valid in a considerably more 

general context. 

PACS numbers: 75.50.Lk (Spin glasses), 64.70.Pf (Glass transitions), 89.20.Ff (Computer science) 
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Motivation 



d i Bethe lattices"'^ can be used to define a large variety of analytically tractable statistical mechanics models. A 
sophisticated (and still improving) theory has been developed for computing the thermodynamic properties of such 
r , systems in great generality (cf. for instance and references therein). Among the recurring predictions of this theory 
' ^ ' is the occurrence (in models with frustration or self-induced frustration) of a dynamical phase transition (DPT) |J. 
While the system free energy remains analytic at the DPT, this is revealed by more refined thermodynamic potentials 
[3 (such as the configurational entropy) which indicate the appearence of a broken-ergodicity phase. 

Despite its eminently dynamical character, the dynamics itself at the DPT is poorly understood. For fully-connected 
(FC) mean field models, in which each degree of freedom (spin, particle, etc) interacts with all the others, one can 
^ usually solve the dynamics in terms of a closed set of equations for the two points correlation and response functions. 
, This is no longer true for models on Bethe lattices, which have finite connectivity (each degree of freedom interacts 
\^ with a finite number of neighbors). Correlation and response functions involving an arbitrary number of times are 
^f) relevant in this case Q. This is somehow healthy: there is no hope to obtain a finite set of closed equations describing 
0^ ' the dynamics of realistic (finite-dimensional) systems. Alternative approaches developed for Bethe lattice models may, 
I on the other hand, prove more general. 

Consider the relaxation of a particular degree of freedom, for instance a spin. As the DPT is approached, dynamics 
slows down because, in order for the spin to decorrelate, a larger and larger number of degrees of freedom have to 
, be rearranged coherently. Our approach consists in computing some detailed properties (e.g. their minimal size or 

a the minimal energy barrier to be overcome in order to realize them) of such rearrangements and then using these 
I , properties to estimate relaxation times. While we shall develop these ideas on a specific Bethe-lattice model, they are 
'"^ ' susceptible of generalization to a variety of other examples. The cases of fc-core percolation and kinetically constrained 
P5 models are, for instance, quite straightforward, and will be treated in a related publication Q (the model treated 
O in the present paper is in fact strictly related to 2-core percolation on random hypergraphs). 

Due to the lack of a simple order parameter and the extensive configurational entropy, the broken ergodicity phase 
is often referred to as a "glassy" phase. In the 80's, Kirkpatrick, Wolynes and Thirumalai Qt t^ stressed the analogy 
between the DPT (in the context of fully-connected models) and the mode coupling transition 0, ini, thus 
^ , motivating a considerable effort aimed at a theoretical understanding of structural glasses. One recent advance has 
been the definition a "dynamical length scale" associated to the dynamical slowing down ^| . Within mean- field 
models and mode coupling theory (MCT) this length scale diverges at the DPT ITslllq . However, the relation 
between this phenomenon and the diverging relaxation time is poorly understood. Also, the basic physical mechanism 
underlying this divergence in glasses is presumably different from the one occurring in simpler system, and is still 
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misterious [17|. Finally, it would be useful to establish a quantitative relation between the dynamical slowing down 
and some purely static observable. 

In order to clarify these points, let us contrast our understanding of the DPT with the one we have of the 
paramagnetic-to-ferromagnetic transition in the Ising model. In this case a typical configuration close to the transi- 
tion looks like a patchwork of positively and negatively magnetized regions. The typical linear size of each region is 
the correlation length ^, and total magnetization is ^Jx (x being the susceptibility). Assuming that the magnetization 
performs a random walk, we can estimate the relaxation time as r > Since standard scaling theory predicts 
i^l'^ ^ we get T > ^27/1/ jj-^ ^j^g dynamical scaling hypothesis states that r ~ with exponent z>2'^/v isj. 

A further source of motivation is to understand the role of activation at the DPT. Much of our understanding of 
this phase transition comes from the study of a particular model: the p-spin spherical spin glass [Tol I20l l2]| . MCT 
has been shown to be exact for this model 0|. Moreover, the energy landscape and its relation to dynamics are 
relatively simple 0. Above the transition t"perature, the system n^ver visits minima and moves among saddles. 
As temperature is lowered the number of energy-decreasing directions decreases, slowing down the dynamics (23j. 
Below the critical point, the system is typically found near a local minimum and is separated by diverging (in the 
thermodynamic limit) energy barriers from other minima. Activation is therefore irrelevant both above and below 
the DPT. It is not necessary in the first case, and it cannot take place within physical time-scales in the second. 
This has lead to question whether activated processes could spoil the predictions of MCT for more realistic (finite- 
dimensional) models. In this case a standard nucleation argument suggests that ergodicity is restored within a finite 
(in the thermodynamic limit) time p^ . 

Like other mean-field systems, models on Bethe lattices are characterized by diverging energy barriers within the 
broken ergodicity phase. Therefore, they cannot help understanding the role of activation in this regime. On the 
other hand, finite energy barriers are present in the ergodic phase and one may ask whether they modify the MCT 
critical behavior upon approaching the DPT. Notice that such a question is in general not well-defined because the 
distinction between activated and non- activated processes becomes sharp only in the zero-temperature limit. In the 
following we shall study in detail a zero-temperature multi-critical point where the distinction makes sense. 



B. Overview of the paper 

The model and some basic notations are introduced in Section^ The phase diagram is described in terms of two 
basic parameters: the temperature T, and a which quantify the degree of constrainedness of the system. We then 
discuss the critical properties of the DPT in Sections IlIII and HVI Let Td be the phase transition temperature. We will 
show that n-points susceptibilities stay finite at for any given n. On the other hand, we introduce a correlation 
length £ using point-to-set correlations and show that i ^ {T — Td)~^/^. This correlation length is connected to 
relaxation times using a disagreement percolation argument which implies a bound of the form t > (T — Td)"^^^- 

We then consider the T ^ 0, finite a limit (still within the ergodic phase). In this regime, the dynamics is dominated 
by activated processes and the relaxation time can be derived from a standard Arrhenius argument. The relevant 
large scale rearrangements minimize the energy barrier to be overcome in order to realize them, cf. Sec. I VII The 
barriers height diverges as a increases and approach the DPT point (at which Td = 0). In Sec. IVIll we compute 
several properties of these rearrangements, such as their size, depth and cooperativity. We also consider minimal size 
rearrangements (cf. Sec. 0, which share several properties with minimal barrier ones, and are somewhat easier to 
analyze. We compare the critical behavior as a ^ ad with standard MCT predictions. We find that several of these 
predictions are violated. More surprisingly some universal properties of MCT (such as the divergence of the four point 
susceptibility) hold even in this extremely activated regime. 

The point (a = ad, T = 0) is a tricritical point, analogous to the percolation point in diluted ferromagnets. In 
Sec. lVIlil we use standard scaling theory in order to connect the T — > 0, a < ad and T Td(a) > 0, a > ad regimes. 
The scaling hypothesis is verified through numerical simulations. Under this hypothesis, temperature is a relevant 
variable and a crossover from an activation-dominated to a thermal regime takes place. We argue that the thermal 
regime is controlled by usual MCT critical behavior at any finite temperature. 

Some conclusive remarks are put forward in Sec. IIXI while most of technical calculations are collected in the 
Appendices. 

A synthetic account of our results was published in Ref. p^. 
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FIG. 1: Schematic view of the phase diagram of the diluted p-spin model. 



II. DEFINITIONS AND NOTATIONS 



A. 



Model 



In this paper we focus on Ising models with p-spin [p > 3) interactions: 




(1) 



(ii...ip)G5 



Here at = ±1 are N Ising spins, Q is a. set of M = Na p-uples of indices, and Ji^...ij, are quenched couplings taking 
values ±1 with equal probability. The above Hamiltonian is twice the number of violated constraints <Ji^ ■ ■ ■ (Ji = 
Jii...ip- Since this condition can be written as the exclusive OR of p boolean variables, the problem is known in 
computer science as XORSAT |2^. Any configuration satisfying all these constraints has zero energy (is unfrustrated). 

In order to complete our definition, we need to specify the (hyper)graph of interactions Q. In this paper we consider 

to be a random graph constructed by taking the M interacting p-uples of sites {(«i . . . ip)} to be quenched random 
variables uniformly distributed in the set of (^) possible p-uples |23|. In the thermodynamic limit N ^ oo, the number 
of interactions a given spin belongs to (its degree) is a Poisson random variable with parameter pa. Moreover, the 
shortest loop through such a spin is (typically) of order log^, N with c = p{p — l)a [28l |. 

This property allows (at least in principle) for an exact treatment of the thermodynamics. The phase diagram is 
sketched in Fig. ^ For a < ad and above the critical line Td(a) the system is ergodic and the free energy density 
is given by the usual paramagnetic expression — /3/ = log 2 + a ((log cosh /3) — 1). The free energy density remains 
analytic across the line T(i{a), but ergodicity is broken in the whole region T < T(i(a). Finally, a true thermodynamic 
transition of the random- first order type takes place at Tc{a). 

Two regimes have attracted particular attention. In the "fully-connected" limit a — s- oo, T cx both statics 
and dynamics can be treated analytically, showing a typical MCT transition 0, ■ The relaxation time diverges as 



In the zero-temperature, finite a limit, probabilistic methods can be used to show that zero-energy ground states 
with finite entropy density exist for a < ac- However the set of ground states gets splitted in an exponential 
number of clusters with extensive Hamming distance (number of spins with different value) separating them for 
ad < a < Cic [sol l3lj . A finite fraction of the spins does not vary among the ground states of a particular cluster, 
while they change when passing from a cluster to the other. At ad the fraction of frozen spins jumps from to a 
finite value 4>d- For instance ad ~ 0.818469, ac ~ 0.917935, and 0d ~ 0.715332 when p = 3. This phase transition 
can be characterized in a purely geometrical way. It corresponds to the appearence of a 2-core, i.e. a subgraph of Q 
such that any of its vertices has degree at least 2 in the subgraph. The largest 2-core in Q, denoted as ^corc, includes 
|^/coro| — 0{N) vertices above ad. The subgraph of frozen spins will be referred to as "backbone", ^bonc and can 
be constructed recursively as follows. Start from t/bono — Qmic, add to it any hyperedge of Q having at most one 
vertex not yet in t/bono, and repeat until such an hyperedge exist. In view of these remarks, it is not surprising that 
several results of this paper can be generalized to kinetically constrained models (in this case the relevant geometrical 
transition is the fc-core percolation [sL l3^ ) . 

No exact result exists for the dynamics at any finite value of a. Standard generating function methods allow to 
formally derive a hierarchy of dynamical equations for multi-time correlation and response functions 0|. Several 
approximation schemes have been proposed |3^ l3^ for this hierarchy. Such approximations have been developed 
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FIG. 2: Example of factor graphs. 

mostly within models with a continuous transition (typically, the model with p = 2). However, their generalization 
to models undergoing a discontinuous transition is straightforward. Unfortunately such approximations break down 
in the critical regime T | Td(a). 

In the following we shall use repeatedly two useful properties of this model. First: as long as there exist at least 
one zero-energy ground-state, all such ground-states are equivalent. Suppose that cr(*) is such a ground state, and 
that a is an equilibrium configuration for the Hamiltonian Q at temperature T. Define cTj' — of^ Gi (this is often 
called a "gauge" transformation). Then a' is distributed according to the Boltzmann measure with an Hamiltonian 
of the form with the same graph Q and temperature T as the original model, but with Ji^...ip — +1 for all the 
interactions (ferromagnetic model). Therefore any property of cr'-*) which is invariant under this change of variable 
can be computed for the (7^+' = (+1, . . . , +1) ground state of the ferromagnetic model. In particular, for T = 
this implies that the ground states of the J = ±1 model as observed from a'^*\ "look like" the ground states of the 
ferromagnetic model as observed from cr'^+^ . 

The second property will be used uniquely in numerical simulations and can be stated in two parts: (i) As long as 
Q does not contain hypcrloops (i.e. subgraphs such that each site has even degree) the partition function of the model 
is exactly given by the annealed computation, i.e. Z^^pi^J) — 2^(e^'' cosh/3)*^, (m) Under the same hypothesis, 
sampling the sign of the couplings J = {Jii...i } (for a given graph Q) and then the configuration a according to 
the Boltzmann distribution is equivalent to sampling a from the uniform distribution and then the couplings as 
independent random variables with distribution 

^^^^'-'^^^^ ^ 2^kh^ exp{/3J.,....^a.,...a,^} . (2) 

The proof of this statement is deferred to Appendix 1X1 It is a consequence of the results of Refs. 113,1^ that, for 
a < Q!c a random graph Q constructed as above does not contain any hyperloop with high probability. 

Sampling first a and then J is much simpler than the opposite. We shall adopt this procedure in order to generate 
thcrmalized configurations for simulating the equilibrium dynamics. It is an open (and interesting) problem whether 
the same procedure can be useful in the region a > ac, T > Tc{a) (at least for large enough systems). 

B. Averages, factor graphs and messages 

In this paper we shall denote by ( • ) expectation with respect to the Boltzmann measure at inverse temperature /3, 
and by E( • ) expectation with respect to the quenched disorder (i.e. the graph Q and the couplings Ji-^..Ap € "ID- 
Connected correlation functions (see, for instance, 01 for a definition) are denoted by ( • )c. 

Factor graphs [3^ provide an useful representation of models like the one studied in this paper. These graphs have 
two types of nodes, one for interactions ("function nodes", squares of Fig. 12) and one for spins ("variable nodes", 
circles). Edges connect each interaction with the spins involved in it. The graph is obviously bipartite. 

We shall use indices a, /3, . . . to denote function nodes, and i, j, fc, . . . for variables. Directed edges in the graph will 
support messages of two types, Ua^i, and Vi^a, with various meanings depending on the context. We denote by da 
the set of variables in the interaction a, and by di the set of interactions the variable i belongs to. In this context \ 
will denote the substraction of an element from a set. 
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Let T be the factor graph associated to the model (0. The degree of function nodes in T is fixed to p, whereas 
the one of a generic variable node converges to Poisson random variable of parameter pa. A path in is a sequence 
of nodes, such that any two successive nodes are joined by an edge. The distance between two variable nodes i and 
i is the length (number of function nodes in it) of the shortest path graph joining them. Two variables are said to 
be "adjacent" if their distance is equal to one, and connected if there is a path joining them. A set of variables is 
connected if its elements are pairwise connected. An important property of random graphs, on which we shall come 
back later, is that, in the N ^ oo limit, any finite neighborhood of a generic site is, with high probability, a tree. 

Finally, for asymptotic behaviors (here as n ^ oo) we write: a„ b„ if (a„/6„) is bounded away from and oo for 
n large enough; a„ ~ 6„ if (a„/6„) 1. Further a w 6 if a is numerically close to b. 

C. Glauber dynamics 

Most of our results can be applied to general single-spin flip Markov dynamics satisfying the detailed balance 
condition. Furthermore, the generalization to block (multi-spin flip) dynamics is in several cases straightforward as 
far as the block size is kept finite as iV ^ oo. 

For the sake of definiteness, the reader may refer to Glauber dynamics in continuous time. At each spin (7^, a flip 
is proposed in a time interval dt with probability dt (i.e. according to a Poisson process of rate 1). Whenever a spin 
flip is proposed at site i, the new value of ct^ is drawn from the conditional distribution, given the neighboring spins 

f'/3(CTj|cr[iV]\j) « exp|/3cr, ^ Ja ^ CTj | , (3) 

a£di j£da\i 

(the constant hidden in the cx symbol is here independent of ai). Whenever precise non- asymptotic estimates on 
correlation times will be given, they will refer to these transition rates. 

The basic observables we shall use in order to probe this stochastic dynamics are single spin correlation functions 

a{t) ^ {a,{oy,{t)) . (4) 

Here expectation is taken with respect to the equilibrium dynamics, i.e. cr(0) is an equilibrated conflguration, and 
a{t) is the conflguration obtained by applying the above dynamics for a time interval t. One can also consider the 
global correlation function C(t), defined by averaging Ci(t) uniformly over the spin position. 

III. ORIGIN OF THE DYNAMICAL TRANSITION 

Since purportedly, the dynamics gets slower and slower upon approaching Td{a), it is quite natural to think that 
spatial correlations in the equilibrium measure must become stronger in the same regime. In this Section we first show 
that n-point correlations remain short ranged at the dynamical transition. On the contrary, point-to-set correlations 
diverge at Td(a). We show that this indeed implies a divergence in properly defined relaxation times. 

A. n-points correlation functions 

A simple way for characterizing correlations in the system consists in considering n-points spin-glass susceptibilities 

Xl%=^ T.{''^^■■■'^^Jl■ (5) 

*1 ■ ■ -in 

We are eventually interested in the thermodynamic limit. The rationale for considering the spin-glass susceptibility 
is that E(crij • • • ai^)c = unless ii = ■ ■ ■ = in and n is even ^. We claim that for any fixed n, the susceptibilities (O 
remain finite across the dynamic transition Td(a). More precisely, for all T > Tc{a), with high probability 

xl%<CUP,a), (6) 



^ Whenever {ii , . . . ,in} contain an index i repeated an odd number of times, a simple gauge transformation implies that ¥,(ai-^ ■ ■ ■ )c = 
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for some bounded functions C„(/3, a). In other words, n-points correlation functions give no hint^ about the dynamic 
transition as far as n is finite. Here we will sketch a proof of this claim in the zero-temperature limit (the approach 
is essentially rigorous in this case) for n < 2. Technical calculations, together with a cavity argument for n > 2 or 
T > are presented in Appendix IbI 

Consider a < ac'- the system will typically contain an unfrustrated ground state a^*\ so we apply a gauge trans- 
formation and reduce ourselves to the ferromagnetic model Ji^-.-i^ — +1. Since {<y[*^Y = the definition (O remains 
unchanged in the new variables (which we still denote as a). In the ferromagnetic system [ui^ ■ ■ ■ (Ti^)c = or +1 for 
any ii, . . . , i„ and n < 3. In fact {ai-^ ■ ■ ■ <Ti^) = or 1 (for the not-connected correlation function). If cTij • ■ ■ Ui^ = +1 
in all the ground states then ((7^^ • • • (Ji^) = -t-1 trivially. If on the other hand there exist a ground state cr'^^) such that 

a\~^ • ■ • a[~^ = —1, this is the case for exactly one half of the ground states (for each ground state with cJi^ ■ ■ ■ (T,;„ — +1 

we can construct one of the other type multiplying it by a\ ') and therefore ((7^^ • • • ct^^) = 0. As for the connected 
correlation (ct^j • • ■ai^)c, being sum of products of ordinary correlations, it is an integer. Furthermore, it is non- 
negative because of Griffiths inequality for n = 1, 2, and by simple enumeration of the possible values of (ai-^ai^Ci^) , 
(ai-^ai^), and so on, for n — 3. Using the definition of (• • ■)c it is finally easy to show that it cannot be larger than 
one. We therefore proved the simplified expression 



An,N — 



1 J2 K •••^.:J 



for T = 0, < 3, and a < Uc 



(7) 



Let L — {ji, . . . ,ji} with jk E {1, . . . , N} a list of (not necessarily distinct) spin positions denote by Zg{L) the 
number of unfrustrated ground states such that — +1 for any i E L. We take I to have Poisson distribution with 
mean NX (with A > 0) and {ji, . . . , j;} i.i.d. uniformly distributed in {1, . . . , N}. Let 



V'e(A) 



1 

N 



denote the ground state entropy of the system in which we forced a., 

N 

dX „ N 



1 ^ 

,-1 



ELl0g,Zg{L). (8) 

= -fl for any i E L. Simple calculus reveals that 

= ^E('^^^^-)- (9) 



dA2 



Therefore, proving the thesis for n < 2 is equivalent to proving that the first two derivatives of ipg (A) are bounded. 

By computing derivatives at A > 0, one can show that iJjqW is non-increasing and convex in A. Furthermore, since 
each constraint (either ai-^ ■ ■ ■ (Ji = +1 for (ii • • • ip) edge of G or (jj = +1 for j G L) at most halves the number of 
zero-energy ground states, we have the bound ipg{X) > (1 — a — A). Moreover, it is simple to derive an upper bound 
through an annealed computation (we refer to Appendix IbI for the details). Define 



V'ann(A) 



sup 'H(w) 



a log2 



1 -I- (1 - 2uj)P' 



X log2(l — Uj) 



(10) 



where 'H{ijj) — — a;log2 lo — {\ — lo) log2(l — oj) is the binary entropy function. Then one can prove that, given £ > 0, 
i^oW ^ '0ann(A) -|- eA^ for any A > with high probability. It turns out that there exist aann, with < Ofann < etc, 
such that, if a < aann, 



■0ann(A) = 1 - Q; - A + 



X^ + OiX^). 



(11) 



For instance we obtain a. 



2 log 2 

0.889493, 0.967147, 0.989163 for, respectively, p = 3,4,5. These bounds imply in turn 



dlpg 



dX 



= -1 



< 



d^^Pg 



dA2 



1 

" log2 



(12) 



Thus proving that x^^, n = 1,2, remains bounded for T = and a < Ofann- In Appendix IbI we argue that in fact 
the result remains true up to ac- 



^ One may wonder whether derivatives of X^*jv with respect to T (or a) may give some useful information. It is not hard to generalize 
our arguments to show that this is not the case. 
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B. Point-to-set correlations 



A much stronger criterion for correlations decay is obtained by considering observables depending on arbitrary 
number of spins (i.e. not necessarily bounded by a constant independent of N and a as in the previous Section). 
Here we describe a concrete way for verifying such a criterion and show that it allows to define a correlation length 
diverging at Td(a). 

Fix a configuration cr^"^ drawn from the equilibrium Boltzmann distribution at temperature T. Let i £ {1, • . • ,N} 
be a site in the system and £ a positive integer. Consider a configuration a distributed according to the Boltzmann 
measure, conditioned to aj — crj^'' for all sites j whose distance from i is at least £. In other words, if Siii) denotes 
the subgraph including all the sites at distance smaller than £ from i the distribution of a is 

P« Ja) = / {-f^H{a)} /Zp^e if = erf ^ Vj ^ Giii) f^^. 
'^'^ ^ \ otherwise. ^ ^ 

If £ is small, ct^ will be highly correlated with af^"^ . However, we expect this correlation to decay as — + oo if the 
temperature is hi gh e nough. We are therefore led to define a correlation length as follows (a similar length scale has 
been discussed in |33) 

£,,, (e) = min { ^ : E,(o, [af ^ (tr,),] < e , } . (14) 

Here E^m [ ■ ] denotes expectation with respect to the reference configuration cr^"^ and {■) iS the expectation with 
respect to the measure P/sj{<7). Our definition depends upon the parameter e € (0, 1). However this dependency is 
irrelevant ^ and we can think of it as a fixed small number e.g. e = 0.1. 

The main result of this Section is that £i^*{s) diverges as the dynamical transition line Td(a) is approached. More 
precisely, with non-vanishing probability -with respect to the choice of the site i-, we have (the thermodynamic limit 
being taken at the outset) 

£,,4e)r^iT-Ti{a))-'/\ (15) 

Equivalently, if the dynamical transition is approached by increasing the number of constraints in the system: £i ^(e) ^ 
(ad(T)-a)-i/2. 

Let us consider, for the sake of simplicity the case T = and a "f ad- The finite temperature case will be discussed 
in Add. IbI fwe also refer to ^ more detailed discussion of this issue). The reference configuration cr^^^ is, for 

T = 0, chosen uniformly at random among the exponentially numerous unfrustrated ground states. Without loss of 
generality we can assume that the model is ferromagnetic and cr^^) = a'--^^ is the 'all-plus' cofiguration. Repeating 
the type of arguments already used in the previous Section, one can show that, at zero temperature, {(7i)i is either 
-|-1 (if (Ti is completely determined by the boundary condition together with the requirement of satisfying all the 
interactions) or (in the opposite case). As a consequence £i^^,{e) does not depend upon e: we have {ai)i — 1 for 
£ < 4,* and ((Ti)g = for ^ > £i^^. 

Let be the probability that {ai)e — 1. Obviously = 1- Furthermore, for any ^ > 0, the following recursion 
relation holds 



Ee-^"^[1 - (1 - ^r')'] = 1 - exp { - pa^r'} . (16) 



This formula is proved by summing over the degree of site i the probability that the degree is I (factor e'^" {paY / II) 
times the probability that at least one of the interactions has all the remaining spins determined by their £-th neighbors. 
The dynamical transition point is given by 

ad = sup |a : 0>l-exp{ - pacjf''^ } for </) G (0, 1] | . (17) 

Numerical values of ad are given in Table A simple asymptotic study of the recursion Hl()|) shows that 4>e for 
a < ad, while (pg — s- (j)^{a) for a > ad, (?!>*(a) being the largest solution of = 1 — exp | — pa0P^^}. Hereafter we 



The single-site Edwards Anderson order parameter l38t l3Sl 1401 must however be larger than e to get a non-trivial result. 
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FIG. 3: Point-to-set correlation function for p = 3. Left: graphical representation of the recursion i^f+i = 1 — exp { —pa(j)\ 
Right: function 4>i for a = 0.75, 0.8, 0.81 0.814. 
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FIG. 4: Left: expected point to set correlation at a = 1 and, from left to right, T = 0.7, 0.62, 0.59, 0.58 and 0.575, as computed 
using the recursive approach of Appendix IB 31 Right: point-to-set correlation length i'*(e), as extracted from this data with 
£ — 0.1. The dashed line is a fit to this data according to the asymptotic expression t*{e) — C {T ~ Td)"^''^, with Td = 0.51695. 



shall use the notation (f)^ — ^^(ad). For any p > 3, </)d > and 0*(a) — (t)d + cst^/a — ad + 0{a — ad) for a > ad. 
As already mentioned, ad is the critical value for the appearence of a backbone (and a 2-core) in the graph Q and is 
easy to realize that its typical size is about N(j}t,(a) for a > ad. In the present picture, the spins in the backbone are 
frozen because they are determined by spins arbitrarily far away. 

As ad is approached from below, the convergence of (/)£ to becomes slower and slower. As can be seen in Fig.|31 (pe 
first develops a plateau near (j)^, whose length scales as (ad — a)~^/^ and then decreases to right after this plateau 
(i.e. it decreases below any given constant in a fixed number of iterations). The behavior around the plateau is 
described by the scaling form 



0, ~ 0d + (ad - a)'/'/C[(ad - a)'/\i - 4(a))] 



where 



(18) 



and 



4(a) = -^^(ad-a)-V^ /C(x) 



ta,Il{^/AoA2x} , 



Ao - p^dT' e-P^^-^a - , ^pip - l)ad0r'e-^"^' " {pip - l)ad<P"d 

Therefore, for any given sample, a fraction (f>d of the sites i is such that 



P-'-ip-2)}^ 



(ad-a)-i/2 + 0(l) 



(19) 



(20) 



(21) 



independently of e e (0, 1). 

To conclude this Section, in Fig. 0] we show the results of a recursive finite-T calculation of Eg.(o) [cr|°^ ((7^)^] as a 
function of £, averaged over the graph realization. This allows to extract the typical point-to-set correlation length 
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defined as (here Eg; denotes expectation over the graph realization) 

4(e) = min { £ : EgE^m [fif ^ {cT^)e] < £ } ■ (22) 

Since ¥,g'E^m[af^\ai)i] decreases rapidly to above i*{e), it is not hard to argue that £i,*(e) < Ci£*(£) with high 
probability and ii^*{e) > Co^*(£) for a finite fraction of sites/graphs (Cq, Ci being two positive constants). We 
also plot £^{e) as a function of the temperature for e = 0.1. As anticipated, the scaling £^{e) ^ {T — Td{a))^^^^ is 
remarkably well verified allowing for a precise determination of Td{a). The approach followed for this computation is 
described in Appendix IB 31 



C. Implications for dynamics 

As we have seen, at the dynamic transition line Td(a), the point-to-set correlation length ^^(e) diverges. It is 
intuitively clear that this should induce a diverging relaxation time, associated to the (dynamical) glass transition. 
Imagine for instance to perturb the spin ai. In order for a new equilibrated configuration (under the perturbed 
Hamiltonian) to be produced, the effect of the perturbation must propagate over a distance at least of the order of 
^i^*, taking a time at least of order £i^^,. Therefore yields (up to a finite proportionality constant) a lower bound 
on the relaxation time for a.^. 

Remarkably, this handwaving argument can be turned into a mathematical derivation. For doing this, we need a 
precise definition for the relaxation time of Ci. We consider the spin autocorrelation function Ci{t), and define 

T,{S) ^ min{t > : C,(t) < 5} . (23) 

Notice that Ci(t) is a continuous and non increasing function of t (the last property follows from the spectral repre- 
sentation of the Markov dynamics ji^l). Therefore Ci{t) < S for any t > Ti{S). The precise value of S is irrelevant, and 
it should be thought as a small fixed number. Close to Td(ck), we expect Ci{t) to develop a plateau. The definition 
(|23ll correctly gives the slow time scale for the relaxation of ai as soon as S is smaller than the plateau height, which 
is in turn equal to the local Edwards Anderson order parameter |38l l39j | . 

We also need to introduce a cutoff radius £i: this is the largest integer £ such that the subgraph Geii) is a tree. 

Proposition 1 Assume that £i, £i_^{2d) > log2(4/(5), Ti{d) < {£i — l)/(2Kie) and that the number of sites at distance 
£ from i is at most nf for any £ > and some Ki > 0. Then 

n{S)>^£,,,{2S). (24) 

Proof: The proof is an application of some probabilistic arguments developed in ji^, 0, ■ For greater conve- 
nience of the reader, we shall provide a self contained presentation of most of these ideas. 

Let a^^"^ be an equilibrium configuration for the system under consideration, £ > an integer and recall the definition 
of Ge{i)- Consider two Markov trajectories {a''^\t), t > 0} and {(T*^^-'(t), t > 0} defined as follows. The initial condition 
is the same for both processes and is given by the reference configuration cr^"^: fT^^^(t = 0) = cr'^'(t = 0) = a^^K At 
times t > 0, spin flips are proposed simultaneously in both systems according to the usual Glauber dynamics rule 
(each spin attempts a flip according to a Poisson process of rate 1). If the spin whose flip is proposed lies outside 
Gi{i), the flip is never accepted for and is accepted according to the usual transition probability for a'^^\ If, on 
the other hand, the spin which attempts a flip, let us say j, is within Gi(i), the update is done in the two systems as 

follows. Let {p^'^^pL^''} be the probabilities for crj^'' to take values, respectively, +1 or —1 after the flip. In the case of 

Glauber dynamics, these are computed according to Eq. Denote by {p+'',p'^''} the same transition probabilities 

for system (2), and assume, for instance, that p^^-* > Then, with probability p^_^\ we set aj^'* = aj^^ = +1; with 

probability p'^^' — P+\ we set aj^'' ~ +1 and a'p — —1; finally, with probability 1 — 'p\' ^ a'^^ = g"'^ — —1. 

Recall that the transition probabilities only depend on the values of the spins on the neighbors of j. Therefore, 

the new values of <jf^ ^ a'^p will coincide whenever = a"^) for all the sites j' at distance one from j. Furthermore, 

it is easy to see that when considered separately, the Markov processes {cr'^^(t), t > 0}, {(T^^^(t), t > 0} have a very 
simple description. The latter is the usual Glauber dynamics with equilibrated initial condition u'^*'^ . The former is 
Glauber dynamics for the subsystem formed by spins in Ge{i), with initial condition a^^\ and boundary condition 
(outside Ge{i)) also given by a'^^\ The joint process is in fact a "Markovian coupling" of these two dynamics. 
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At i = 0, cr(^^(t) = cF^'^\t) by definition. Since the two dynamics are diff'erent outside Ge{i) cr^^HO "'^^''(O will 
rapidly disagree there. However, inside Qi{i), disagreement can only propagate at a finite velocity, starting from sites 
at distance i — 1 from i and moving inward. It is intuitively clear that, in order for the disagreement to reach ct^, 
a time of order £ is needed. This intuition can be precised mathematically. Assume £ < £i and denote by N{£) the 
number of sites at distance £ from i. Then 



N{£) . (25) 



This inequality is essentially adapted from |43| . and we refer to this paper for a proof. 

We now turn to the main steps of the proof. Using the definition of {c7^^\t)} and the fact that (f ■^^(O)CTj-^-'(t)) is a 
non increasing function of we have 

E,<o,[af (a.),] = lim (a.^ (0)^^ (t)> < (af )(0)a«(t)> . (26) 

t — 'OC 

Denote by I(t) the indicator function for the event that disagreement did not percolate to i up to time t. More 
explicitly 

fl ifaf)(s)=af)(s)Vs<t, ,271 
^ ^ \ otherwise. ^ ^ 

Continuing from the above inequality we get, for £ < £i, 

E.(o,[af (a.),] < (a,p)(0)af)(t)) = (af (0)af (i) I(t)) + (af )(0)a,p)(0 [1 - I(t)]) = 

= (af H0)af (t)) - (af (0)a,p)(t) [1 - m]) + (af )(0)a,p)(t) [1 - I(t)]) < 



< (af )(0)af \t)) + 2(1 - m) < ait) + 2 ( I ) N{£) . (28) 



S,(o)[af\a,),] < 5 + 2^^4^ ) Ni£). (29) 



Taking t = Ti(S), we obtain 



Now set £ — max[\2KieTi{5)~\ , [log2(2/(5)]]''^. Under the hypothesis of the proposition, £ < £i and N{£) < nf. Therefore 

E,(o) [af ^ {a,)e] <S + 22-'< 26. (30) 

By the definition of ^i*(e), the above equation implies £ > £i ^(26) thus proving our claim (using the hypothesis 
£i,42<5) >log2(4/^)). ' ' □ 

Let us comment on the hypotheses of this Proposition. For a random graph Q, £i is, with high probability, close 
to logp(p_i)„ N [23. The hypothesis £i > log2(4/i5) is therefore satisfied with high probability (although in any given 
sample there is a vanishing fraction of sites i for which this is not the case). 

Furthermore, within any fixed distance £ from i, T converges to a (Galton- Watson) tree. The number of offspring 
is a Poisson variable of mean pa for variable nodes, while it is deterministic and equal to (p — 1) for function nodes. 
Let Ntj:ee{£) the number of £-th generation descendants in such a tree. It is easy to show that, for any k > p{p — l)a, 
A^tree(^) < with probability approaching one as £ — > oo. On the random graph Q, the number of neighbors N{£) is 
in fact smaller than on the tree. As a consequence, is finite for most of the sites in the graph and, roughly speaking, 
of order p{p — l)a for a finite fraction of them. On the other hand, Hi can be much larger (diverging as N —^ oo) for 
a vanishing fraction of sites. In particular, must be at least as large as the degree of i, and the maximal degree in 
such a random graph scales as log A^/ log log A^. 



^ Here and in the following, \x~\ denotes the smallest integer greater than or equal to x, and [x] the greatest integer smaller than or equal 
to X. 
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Finally, the inequality (|24|l is only interesting in strong correlation regimes, such that ^ 1. Therefore, the 

hypothesis ^^^,(25) > log2(4/(5) does not imply any loss of generality. 

In the previous Section we argued that the typical point to set correlation length i'»(e) diverges as (T — Td{a))^^/^ 
upon approaching the glass transition temperature. Therefore we obtained the following lower bound on the typical 
relaxation time: 

T{S)>{T-T^{a))-^/\ (31) 
As explained below, the usual MCT predictions agree with such a bound. 



IV. FROM DYNAMICS TO REARRANGEMENTS 



A. On the relaxation time divergence 

The inequality l|31fl -along with its derivation- explicitly shows how a divergent length scale induces a divergent 
time scale at the (dynamical) glass transition. However, several reasons suggest that this lower bound is not tight. A 
first indication is provided by the usual predictions of MCT. These imply 

t{S) ^ (T - Td)-^"- , 7mct - + ^ , (32) 

with anict, &inct > determined by the equations 

r(i-a„,et)' _ r(n-6„,et)' 



r(l - 2a^,t) r(l + 2b^,t) 



— Anict ) (33) 



and Amct a positive, model-dependent constant between and 1. It is easy to show, using these equations (see also 
Sec. Ell, that 

Omct ^ 1/2, and therefore 7nict ^ 1- Although MCT is not exact for the model studied here, we will 
argue below that several of its predictions are correct (in particular, this can be shown in the fully connected limit 
a ^ oo |3])- If this is accepted, it follows that Eq. (|31() does not predict the correct critical exponent. 

A more fundamental reason for (|31|) not to be tight is the following. This estimate was derived by showing that 
a region of linear size •^i,*(£) requires a time at least of order ^i,*(e) to relax. This is true because a perturbation 
propagates at finite speed under Glauber dynamics. However, the time required for equilibration on such a length scale 
can easily be much larger. Information can for instance propagate by diffusion (leading to t ^ £^) or equilibration 
time may be related to the volume rather than to the linear size of highly correlated regions. 

In order to understand this point, we shall hereafter focus on the low temperature limit at a < ad- In this regime, 
the system spends most of its time in quasi-ground states, and the leading relaxation mechanisms will be "jumps" from 
one such low-energy configuration to a different one. Since the properties of these jumps are likely to be continuous 
with respect to the energy of the starting and arrival points, we shall hereafter assume them to be exact ground states. 

The time scale for relaxation of spin ctj can be estimated in this limit through a standard Arrhenius argument. We 
have Ti ^ exp{/3Ai}, where is the smallest energy to be overcome during a rearrangement of the system which 
flips <7i (a jump). Due to the definition of our Hamiltonian is an even number. For future convenience we 

shall write A^ = 26^, and refer to the Arrhenius law in the form 

n ~ exp{2/35J . (34) 

We will sometimes call bi the "barrier" for spin ai (although, strictly speaking, the energy barrier is 2bi). 

A formal definition of rearrangements is given below. While it is clear that energy barriers are the relevant quantities 
determining time scales in the Arrhenius regime, it is rather involved to evaluate them. For pedagogical reasons we 
shall at first neglect barriers and look for minimal size rearrangements. 



B. Rearrangements 



A rearrangement Ri for the site i is a set of sites such that i belongs to Ri, and for every interaction a, an even 
number of the variables in da belongs to Ri. If one starts from a ground state and flips all the spins in Ri, a new 
ground state is obtained with ai flipped (viceversa, any two ground states which differ at site i, differ in a whole 
rearrangement Ri). A rearrangement Ri is "simple" if it is connected and each interaction contains either zero or 
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two sites of Ri. In the following we shall only consider simple rearrangements, and let this restriction understood. It 
will be clear that, for our purposes (and in particular within the a < regime) there is no loss of generality in this 
restriction. TZi denotes the set of all simple rearrangements Ri. 

We shall consider observables defined on the set TZi, the simplest one n{Ri) being the number of sites in the 
rearrangement. Let us discuss the general strategy on this example. The optimal value of the observable n, and the 
set of optimal rearrangements with respect to their size are, respectively, 

rij = min n(i?j) , 71^""^ = {Ri €Tli\ n{Ri) = rij } . (35) 

Unless it diverges with the system size (which can be checked a posteriori), rii, as well as the rearrangements in 
7?.^"^ can be constructed "as if the graph Q were a tree. A formal justification for this procedure is obtained as 
follows. Consider the neighborhood Gt{i) of radius i around i. Let TZi^^ be the set of rearrangements for the model 

whose factor graph is Qt{i). Denote by ('7^^"') the corresponding minimum rearrangement size (set of optimal 

rearrangements). It is clear that, if Uij < I, the rearrangements in 7?.^-"'' arc also rearrangements for the whole graph Q 
and therefore rii < rii^i. Furthermore, any rearrangement belonging to TZi but not to TZi^i has size at least i. Therefore 
fli = Hit andTef^ =^1"^- Consider now a sequence of random graphs Q of increasing size: if Ui remains finite in the 
thermodynamic limit, £ can be chosen large enough that rii < £ ^md Q({i) is a tree with high probability. 

A minimum-size rearrangement on a tree (and, by the argument above, on a random graph as long as the its size 
is finite) can be constructed through the following recursive procedure. The root i is by definition included in Ri. In 
each of the interactions a G di of its ncighboorhood, exactly one variable, call it j, among the p — 1 distinct from i, 
has to be included in Ri. Let Rj^a be an optimal rearrangement for site j in the subtree containing j but not a. 
Then Ri is obtained by chosing, for each a, the j which minimizes n{Rj^a)- For instance, each time the interaction 
a contains a node j of degree 1, an optimal choice is Rj^a = {j}'- this branch of the rearrangement Ri contains just 
one node. 

If is a random graph, any finite neighborhood of site i converges to a Galton- Watson random tree ^ rooted at i, 
call it T{i). The distribution of is therefore asymptotically the same as the one of minimal rearrangements for the 
root of such a tree. Although, for p{p— l)a > 1, T{i) is infinite with non vanishing probability (corresponding to the 
percolation of Q), the optimal rearrangement size turns out to be finite with probability one up to (> l/p{p— 1)), 
confirming the validity of the procedure described above. 



V. REARRANGEMENTS OF MINIMAL SIZE 



We consider here rearrangements of minimal size, already defined in the previous Section. In computer science 
language, given a solution a of the XORSAT problem, we look for the solution a' which minimizes the Hamming 
distance from a, under the condition a'i = —di. 

The minimal rearrangement for any given site i is necessarily connected. The recursive construction of optimal 
rearrangements described above implies that, as long as rii is finite, optimal rearrangements are simple. 



A. Recursion relations 



As shown in the previous Section, we can describe the computation of rii assuming that the underlying factor 
graph is a tree (we can picture it as a large tree-like neighborhood of i). We introduce two type of messages 
('cavity fields') {i';— ri} and associated to directed edges in the factor graph T. We define Vj^a to be the 

minimum rearrangement size for site j, relative to the subtree rooted at j but not including a (in other words 
Vj^a = raS.nn{Rj^a)- Analogously, Ua^i + 1 is the size of the optimal rearrangement for site i, relative to the subtree 
rooted at i and including only a among its neighbors (the +1 is introduced to simplify the equations below). The 
recursive construction described above implies the following relations 

Vi^a = 1 + V] up^i , Ua^i = min [vj^a] ■ (36) 



More precisely, a bipartite tree with two offspring distributions for the two types of nodes: for Vciriable nodes, this is Poisson of mean 
pa, while function nodes have a fixed number p — 1 of offsprings. 
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FIG. 5: The integrated distribution law of the minimal size of rearrangements. p = 3, from left to right a — 
0.4, 0.7, 0.78, 0.8, 0.81, 0.815, ad- The dashed horizontal line is the order parameter at the transition, « 0.715332. 

Finally, the optimal rearrangement for i in the original graph is obtained by combining optimal rearrangements for 
the subtrees rooted at i: 

rzi = 1 + ^ Ua^i . (37) 

Given the factor graph JF, the recursions (|35|) . H37|) can be solved by iteration (message-passing) starting from the 
initial condition Vi^a — Ua-ti = 0. We found that this iteration converges rapidly for typical random graphs at 
a < ad-, leading to an algorithm of linear time complexity. 

B. Probabilistic analysis 

As already explained, the (asymptotic) probability distribution of Ui can be computed by considering the random 
tree T(i) rooted at i. In this case, the messages {vj^a} and {ua^j} become random variables. Because of the 
construction of T(i), they are identically distributed. We shall denote by q„ the common distribution of the Vj^a^s 
and by q„ the distribution of the Mq^j 's. The distribution of is also q„ because of the memoryless property of 
Poisson random variables. Finally, as long as the corresponding subtrees are disjoint, these random variables are 
independent. 

The relations ^ can be interpreted as recursive distributional equations. Explicit expressions are easily written 
by using the cumulative distributions 

Qn ^ ^ qn' , Qn = ^ Qn' ■ (38) 

n'>n n'>n 

The recursive relations (|3t)|) imply: 

oc 

qn = X/^' X] Qni ■ ■ -qni SnA+ni + ---+ni , (39) 
(=0 ni,...,ni 

Qn - (40) 

Here pi = e~°'P{apy is the (Poisson) offsprings distribution at variable nodes. 

Equations l|39|l and (|40|) uniquely determine Qn, (jn and can be easily solved numerically: knowing the g„ and qn 
for n < m one can determine Qm+i, qm+i- The starting point is given by qi = po, gi = 1 — (1 — PoY~^- 

We present in Fig. [S] the results of this computation. When the average degree a is raised towards its critical value 
ad, a plateau appears in the integrated probability law Q„ (for p > 3), at Qn ~ 0d- This means that a fraction 0d of 
the spins ai have diverging minimum rearrangement size, consistently with the picture of freezing of some spins at the 
clustering transition ad- These are of course the same spins for which £i diverges upon approaching the transition, 
cf. Sec, nil B1 They will belong to the backbone after the addition of a small fraction of constraints. 
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p 




0d 


A 


a 


b 


V 


3 


0.818469 


0.715332 


0.397953 


0.422096 


1.221834 


1.593787 


4 


0.772280 


0.851001 


0.350174 


0.433412 


1.341647 


1.526313 


5 


0.701780 


0.903350 


0.320971 


0.439997 


1.421808 


1.488035 


6 


0.637081 


0.930080 


0.300707 


0.444431 


1.481191 


1.462601 


7 


0.581775 


0.945975 


0.285554 


0.447677 


1.527913 


1.444121 


8 


0.534997 


0.956381 


0.273649 


0.450187 


1.566174 


1.429899 


9 


0.495255 


0.963661 


0.263961 


0.452205 


1.598411 


1.418505 


10 


0.461197 


0.969008 


0.255868 


0.453873 


1.626162 


1.409102 



TABLE I: Values of the critical parameters and exponents for the minimal size rearrangements. 



C. Asymptotic behaviour of the distribution 

The curves of Fig. [3 are strongly reminiscent of the time correlation functions obtained in the mode coupling theory 
of supercooled liquids. Indeed, the equations (|39|) and (|40|l have a structure similar to the one of schematic MCT 
equations, cf. also Add. I^TTl The analogy becomes even stronger if we consider the asymptotic behavior as a — > 
we present here a summary of results, while calculations are deferred to App. IC II 

For a = ctd, the decay of Qn towards its plateau value is algebraic, Q„ ~ ^d + est n"" as rt — > oo (here and below 
est denotes a generic positive constant). The exponent a is the positive solution of the transcendental equation 

where A = (p - 2)/[adP(p - l)0r ] ^ 1] 

is a non-universal parameter. A graphical representation of this equation 

is provided in Fig. 

In the critical region a < ad, one can identify two distinct scaling regimes. The first one is n (a.^ — a)^^/^°, and 
corresponds to the behaviour of around its plateau. We get 

Q„ ~ (/-d + (ad - otf'^ e((ad - afl'^'n) , (42) 

where e( • ) is a scaling function. One can show that e{t) ~ est t^" as i — > (thus matching the behavior at a = ad 
and n fixed) and e{t) ^ —est as t oo. The positive exponent b is fixed through 

r(i + 26) - ^ ' ^^^> 

see Fig. |H1 

The second regime corresponds to the decay of Qn from the plateau at (pd to and is defined by n ~ (ad — a)^", 
where 

= — + — . (44) 
2a 26 ^ ' 

We get the scaling form 

Qn ^ Qsiow {{ad - a)" n) , (45) 

with Qs\ow{t) a second scaling function. One finds that Qs\ow{t) — (f>d — est i** as t — > 0, while Qs\ov/{t) vanishes faster 
than exponentially as t — > oo. Numerical values of the various exponents for some values of p are collected in Table 

Notice that the scale (ad — a)^'^ has a very concrete interpretation. For any e > 0, one may ask what is the smallest 
size rig, such that all but a fraction e of the sites have a minimal rearrangement whose size is at most n^. If e < 0d, 
one has ^ {a^ — a)^"^. 



VI. REARRANGEMENTS OF MINIMAL BARRIER 



In the low temperature limit, the time scale for the occurrence (flip) of a rearrangement Ri, is given in terms of the 
corresponding energy barrier b{Ri) by the Arrhenius law, cf. Eq. (|34|l . In the previous Section we explained how to 
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FIG. 6: The exponent a (respectively —h) is the positive (respectively negative) root of the equation represented here, see 
Eqs. 



optimize Ri with respect to a simple observable: its size n{Ri). We want now to apply the same strategy to a more 
involved quantity, the barrier b{Ri), and use the result to estimate the relaxation time r^. 

Before dwelling into the actual computation, it is worth stressing that energy barriers (and their distribution) are 
directly related to auto-correlation functions. Consider a spin i of barrier bi. If 6 is a real number, fixed in the P oo 
limit, then 

l^ait^e^^^)Jl :;j<J- (46) 



Let Qf^? (cf. also Sec. I VI P)) be the fraction of sites i such that bi > b. By averaging the above equation over the site. 



'[61 

we obtain 



lim C{t = e^'^'') = gff . (47) 



/3-+00 



A. General considerations 



Let us first expose the basic idea in an informal way. Given a rearrangement Ri , consider the paths in configuration 
space which lead from a groundstate a to the one obtained by flipping all the spins in Ri. The barrier b{Ri) 
associated to this rearrangement will be the minimum among all paths of the maximal energy along the path. If we 
let bi = min/f. b{Ri), the asymptotic relaxation time for spin Ui can be determined through Eq. H34() . 

Paths in configuration space are definitely complex objects. Let us make the simplifying assumption that on the 
optimal ones, each variable of the system is flipped at most once. In the worst case, under this assumption we will get 
an upper bound on bi. We think that this upper bound is in fact tight: in Sec. IVI d we shall provide a lower bound 
supporting this claim. Numerical experiments, cf. Sec. IVIIll also confirm this hypothesis. 

Paths are thus defined by (i) the set of variables which are flipped, Ri] {ii) the order in which they are flipped, i.e. 
a permutation of the site indices in Ri. Arguing as in Sec. II V 61 one can show that, as long as optimal rearrangements 
remain finite in the thermodynamic limit, we can assume that Ri is simple. Their typical size will be computed in 
Sec. I VIl'Xl validating this assumption for any a < a^. 

Let us first consider the task of optimizing over (ii), i.e. the ordering of spins, for a given choice of the rearrangement 
Ri. Take the spins of the rearrangement to be the vertices of a graph, and put an edge between any two vertices 
corresponding to interacting spins. The resulting graph will be a tree with high probability as long as Ri is finite. 

Imagine to put a ferromagnetic Ising model on this tree, with all spins initially up, and to flip them in the order 
defining our paths in configuration space. The energy of the original system along the path which flips Ri is equal 
to the one of this fictitious ferromagnetic Ising model. Therefore, b{Ri) is just the energy barrier to be crossed for 
reversing the spins of a ferromagnetic Ising model defined on a tree associated to Ri (by flipping each spin exactly 
once). In the following Section we shall study this problem and define one way to solve it. Then we turn back to the 
optimal choice of the rearrangement cf. point (i). 



These are sequences of configurations such that any two successive configurations differ by one spin fiip. 
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B. The minimal cutwidth problem and the disjoint strategy 

As a first step, we must compute the energy barrier for reversing the spins of a ferromagnetic Ising model defined 
on a tree. For the sake of simphcity, we shall define the energy of this fictitious model as the number of links between 
spins with different values (plus and minus). The energy in the original model can be recovered by multiplying by a 
factor 2. 

This problem was considered in Ref. (4^ which gave an heuristic prediction of the behavior of bi for large trees, 
and in |47i | which considered the case of regular tree. 

It is instructive to study two very simple instances of the problem. The first one is the case of an unidimensional 
graph of n sites. The optimal flipping order consists obviously in starting from one end of the chain and then proceed 
along it by flipping succesively neighboring variables. The minimal energy barrier in this example is then 1. Consider 
as a second simple case a star-like graph with one central site connected to I neighbors. After an instant of thought, 
one realizes that the minimal barrier is obtained by flipping first half of the external spins, then the central one, and 
finally the remaining half of the external sites. The energy barrier, achieved just before or just after the fiip of the 
central site, is [|] . 

An useful graphical representation of the problem is the following. If one draws the graph with its vertices aligned 
on an horizontal axis, ordered according to the temporal sequences in which the spins are fiipped, the energy at a 
given instant of time is simply the number of edges which are drawn above this point of the temporal axis. The energy 
barrier is crossed at the point where this number of edges is maximal. In fact the problem of fin ding the ordering 
which minimizes the energy barrier is known in graph theory as the minimal cutwidth problem, see |59l | for a review. 
On general graphs minimal cutwidth is NP-complete. However, it becomes polynomial when restricted to particular 
families of graphs, such as trees 60, 61]. We shall present now a simple strategy, known as disjoint combination ^6^, 
which allows to construct "quasi optimal" orderings. The errors induced by this simple approach, together with the 
optimal strategy, are discussed in Sec. IVIFI 

As often, a tree-structured problem is efficiently tackled by a recursive approach: if one knows a solution on a 
sub-tree, it is enough to combine the solution of the different branches to obtain a solution on the original tree. 
More precisely, let us consider a rooted tree T composed of the root and I sub-trees Ti , . . . , T/ , rooted at vertices 
1, . . . ,1. We shall denote by (respectively t9i, . . . , ■(?/) a permutation of the vertices of T (resp. Ti, . . . , Ti). Our 
aim is to find the optimal as defined above. Within the disjoint strategy, one restricts to trajectories which 
forbid having two partially fiipped sub-trees at the same time. In other words, one chooses a permutation tt of [1,1], 
an integer j G [0,1], and flips first all variables of the sub-tree T^^^i), then those of T^(2), and so on mitil T^(j), 
then one fiips the root 0, and proceed with the sub-trees T^(j_|_i), . . . , Tj^{i)- The permutation "i? thus takes the form 
('i?7r(i), • ■ • , '^TT(j), 0, i?7r(j+i), . . . , ^Tr(i))- An example is provided in Fig. |7| where the rooted sub-trees are represented 
as bubbles. The optimization with respects to d is now an optimization with respects to tt, j and the sub-trajectories 
di,. . . The crucial simplification of the disjoint strategy is that the trajectories of the different sub-trees are 
non-overlapping in time (this is clear on Fig.0), and can thus be performed independently of each other. Indeed, let 
us define b{T, 'd) as the maximal energy encountered during the flips of a rooted tree T following the ordering and 
b^{T, (resp. b^(T, t?)) the maximal energy encountered before (resp. after) the root of T has been fiipped. From the 
graphical representation of Fig. \7\ and considering the maximal energy reached in each period of time corresponding 
to a different sub-tree, it is easy to convince oneself that 

b{T,-d) = max |6<(T^(i), 79^(1)), 1 + 6>(T^(i), . . . , j - 1 + fo<(T^(j),i?7r(j)), J + b>iT^ij),-^7,U)), 

I - j + ^<(T'w(i+l): l?7r(j-|-l)): I ^ j ^ 1 + ^> (^^O + l) , ) , ■ • ■ , 

1 + &< (T,(i) , 79,(,) ) , 6> (r^(i) , ) } . (48) 

The minimal barrier b{T) within the disjoint strategy is then obtained by minimizing over 7r,j and the i?i's. From 
the above expression it follows that the last optimization can be done independently, leading to an expression of the 
form b{T) = /K&(Ti), ...,b{Ti)), where 

fl{{b^}) = min max {6^(1), 1 + 6^(3), . . . , j - 1 + - 1 + Ku+i), • ■ • ,1 + K{i-i),K{i) } , (49) 

and b(T) is defined for an arbitrary rooted tree T by 

fe(r) = minmax[6<(T,i9),l-f-&>(r,i9)] . (50) 

The last quantity is the minimal energy barrier for the tree T supplemented by a link ( 'anchor ') between its root and 
a fictitious spin which is never fiipped, hence the shift -1-1 on the energy after the fiip of the root. Note that b{T) does 
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FIG. 7: The disjoint strategy, i = 4,j = 3,7r = (3,2,4,1), we used the shorthand notations 6<(j) = b^{Ti,'&i), by.{i) = 
6>(Ti,i9i). The numbers indicate the maximal energy inside each time epoch, delimitated by dashed lines. 

not change if we intervert the role of 6< and 6> in the definition, a property which has been used in deriving Eq. H49|l . 
In other words, the relevant information on the sub-trees needed to choose the ordering is not their optimal barrier 
b but the anchored barrier b. This happens because one has to take into account the energy of the links between the 
root and the roots of the sub-trees. 

The expression (|49f) for /; can be simplified by noticing that for an optimal permutation tt, the minimum with 
respect to j is reached for j = [|] . We get therefore 

(51) 

A slightly different recursive equation holds (within the disjoint strategy) for the anchored barriers. We have in 
fact b{T) - /i({S(Ti), . . . ,S(T,)}), where 

M{bi}) = minmax[S^(i), 1 + 5^(2), . . . , j - 1 + K(j),l -j + K{j+i),- --,2 + 1 + . (52) 

Again the optimal choice of j is [^] , and the above expression simplifies to 

(53) 

For a tree T containing only the root and no edge, one defines b{T) — 0, b{T) — 1. Using this initial condition the 
above recursions can be efficiently applied to any tree. In particular one can reproduce the results of the two simple 
examples quoted before (linear and star-like trees). 

C. Application to the p-spin model 

Let us now come back to the original problem of determining the minimal energy barrier to flip one variable, say 
CTi, in the p-spin model 1^, ending up in a ground state. With respect to the computation presented in the previous 
Section, we have one more degree of freedom to optimize on: the choice of the rearrangement Ri. This step can also 
be performed recursively. For each of the function nodes a adjacent to i, we must choose a variable node j 7^ i in 
da, which belongs to Ri. The choice is of course dictated by the minimization of the anchored energy barrier in the 
corresponding cavity graph. Using again the message notation, we have 

Ua^i niin [v-j^a] , Vi^a = f\di\-l{{Uf3^i}i3edi\a) , (54) 

where by convention fo — I. Given the graph Q, these equations can be efficiently solved through an iterative 
(message-passing) procedure starting with the initial condition Vi^^ — u^^i = 0. The minimal energy barrier to flip 
the variable i is then computed using: 

^ f\di\{{Ua^i}ai£di) , (55) 

with fo — 0: an isolated spin can be flipped without modifiying the energy of the system. 



mm max 

7r ie[ld] 



/;(6i, . . . ,bi) = min max 

TT ie[iJ] 
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FIG. 8: Integrated law for the distribution of barriers, plotted from left to right for a = 0.816, 0.818, 0.8184, 0.81846. 

D. Probabilistic analysis 

If we now consider a random graph Q, the messages on the edges of the factor graph are random variables, with 
laws qb for the messages and qi, for the u's. We use the same notation as in Sec.0 there should not be confusion 
between the two computations. Capital letters denote again cumulative distributions Qb = 'Ylib'>b lb' j Qb = X]b'>b 96'- 

Arguing as in Sec.lVRl one can show that the recursions (I54|) imply the fohowing distributional equations 

oo 

Qb^Y^p^ <5fc,/-(fc,,. ..,&,) , Qb = Qr\ (56) 

;=0 bi,...,bi 

where pi — e~^°' {paf /l\ is the Poisson distribution of parameter pa, and we set by convention /g = 1. The distribution 
for the barriers ® bi is then obtained using Eq. (|55|l : 

oo 

9r° = Xl^' XI ^b^---ibi 5b,h{b^,...M) ■ (57) 

/=0 bi,...M 

Here, by convention, /o = 0. 

The equations (|56|l to H57|l can be solved numerically, even if this task is a bit more involved than for the distributions 
of minimal size rearrangements. Some details can be found in App. lCTbl The results are plotted in Fig.|Hl for several 
values of a approaching ctd. 

E. Asymptotic behaviour of the distribution 

The critical behavior of ^ Qb, cf. Fig. [SJ presents some similarities with the distribution of minimal size rearrange- 
ments. As Qfd is approached, a plateau develops at Qb ~ (j)d- Eventually Qb decreases to at a scale h diverging 
as a — > ttd. The precise critical behaviour can be derived analytically revealing both analogies and differences, cf. 
Add. IC 2"cl for technical details. Here is an overview of the results. 

At the critical point a = Ofdi the plateau is approached exponentially, Qb — (/)d + cst e"'^"'' as 6 — s- oo. The parameter 
uja is the unique positive root of the equation 

2e"" - e^'^" ^ A , (58) 



The cumulative distribution of bi was simply denoted as Q5 in Ref. I25i . 

For notational simplicity we refer to Q^, rather than to Q|'''^: the two distributions have indeed the same behavior. 
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LUb 


T 


fJ-a 




^barr 


3 


0.574317 


1.495740 


1.204882 


0.816504 


3.903496 


2.015719 


4 


0.591180 


1.640504 


1.150551 


0.798466 


4.164498 


1.944590 


5 


0.601050 


1.737456 


1.119655 


0.787987 


4.341305 


1.904838 


6 


0.607719 


1.809338 


1.099093 


0.780941 


4.473350 


1.878702 


7 


0.612614 


1.865937 


1.084136 


0.775785 


4.577858 


1.859868 


8 


0.616408 


1.912315 


1.072615 


0.771801 


4.663830 


1.845467 


9 


0.619461 


1.951413 


1.063378 


0.768599 


4.736535 


1.833994 


10 


0.621990 


1.985085 


1.055750 


0.765953 


4.799310 


1.824570 



TABLE II: Exponents for the minimal barrier rearrangements. 




FIG. 9: The parameter uja (respectively —ujb) is the positive (resp. negative) root of the equation represented here, cf. Eqs. I58L 



where A is defined as for minimal size rearrangements, cf. Eq. H41II . A graphical representation of this equation is 
provided in Fig. [SJ and numerical values of the solution can be found in Table Ull 

The scaling regime describing the plateau is defined by a ^ ad with b—bo{a) fixed, where bo{a) = log(a(j — a). 

The form of the cumulative distribution in this limit is 

Here im is a scaling function defined on the integers. One can show that Im — est e~' 



as m 



-est e'' 



as m ^ cx), where 



2e- 



A 



This implies that Qt decreases from the plateau to on a scale b : 

1 1 



-T log(Q;d — a), where 



T = 



(59) 
-oo and 

(60) 
(61) 



More precisely, for any e (0, (j)d), the smallest b such that Qb < Q*, say 6*, behaves as 6* = — T log(ad — a) + 0(1). 

Finally, as b —^ oo, the cumulative distribution vanishes faster than exponentially: Qf, ^ exp{— (26) log(26)}. 
Barriers significantly larger than — T log(Q;d — a) are therefore very rare and related to sites of exceptionally large 
degree / (leading, as in the simple example of star-like graphs, to 6 « LV^J)- 



F. Yannakakis algorithm and single sample analysis 

The computation of energy barriers in the previous Sections relied on two assumptions. First, we assumed that 
along an optimal trajectory in phase space, each spin of the system is flipped at most once. We showed that the 
problem is then reduced to the computation of the minimal cutwidth of a tree (once the rearrangement Ri is given). 
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FIG. 10: Minimal cutwidth problem for a binary tree of 5 generations (only one half of the tree is represented, the second 
follows by symmetry). Top: ordering produced according to the disjoint combination strategy, with a cutwidth of 4 reached on 
the dotted line. Bottom: an optimal ordering of cutwidth 3. 

The second hypothesis was the use of the disjoint combination strategy to determine the minimal cutwidth. Here we 
begin by revisiting this second assumption, further analytical arguments will be presented in the next Section. 

In general the disjoint combination strategy is not able to find the minimal cutwidth of a tree, and provides only 
an upper bound on it. The simplest example is provided by a binary tree (in which each vertex has two "sons") of 
height (number of generations) 5. As shown on the upper part of Fig. 1101 the disjoint strategy predicts in this case 
a minimal cutwidth equal to 4. However, the ordering in the lower part of Fig. 1101 achieves a cutwidth equal to 3. 
This ordering is not disjoint: there are points in the horizontal time axis such that two height-3 subtrees are partially 
flipped. 

Yannakakis has presented in fs^l an algorithm which solves exactly the minimal cutwidth problem for any tree in 
polynomial time. This procedure is quite involved. We shall recall here a few selected features which are relevant for 
the application to our case The computation relies on the definition for any rooted tree T of a cost function c(T), 
which is a sequence of integers. The length of c(T) can, in principle, be as large as the number of vertices in T. The 
cost function contains, along with the minimal cutwidth of T, additional informations which were discarded in the 
disjoint strategy. Furthermore, it has two crucial properties: 

• It can be computed recursively. If the root of T has / sons, which are roots of the sub-trees Ti, . . . , Tj, there is 
a function such that c(T) = f^{c{Ti), ...,c{Ti)). 

• The cost of two trees can be compared. More precisely, there exists an order relation among costs, and the 
application f^^ is monotonously increasing with respects to this relation. 

We want to compute the minimal barrier for a spin i in a given p-spin sample, by optimizing over the rearrangement 
Ri and the flipping order of the spins in Ri. Thanks to the two properties above, this task can be accomplished 
through an iterative message-passing procedure which uses Yannakakis strategy. Messages Ua^i and Vi^a are now 
cost functions, obeying Eqs. H54|l . where the minimum is taken in the sense of the order relation on cost functions, 
and // is replaced by f7. When the fixed point of these equations has been reached, the optimal cost function for any 
spin is given by Ci — f^^{{ua-ti}aedi)- The minimal energy barrier bi is then one piece of the information contained 
in Ci. 

As explained before, one expects that the local correlation time of spin i is given, in the low temperature limit, 
by the Arrhenius law (|34|l . We checked this fact by Monte Carlo simulations. Some results are presented in Fig. 1111 
On a given sample Q of size N = 10^, and constraints density a = 0.6, we measured the correlation functions Ci{t) 
for 20 randomly chosen spins, at various temperatures. We generated the equilibrium initial configurations efficiently 
using the property proved in App. ^ In order to avoid the slowing down of usual Metropolis-type algorithms in the 
low-temperature limit, we implemented an n-fold Monte Carlo algorithm {54|. A few examples of correlation functions 
are shown in the left panel of Fig. ^2 We estimated the auto-correlation time from Ci{Ti) — 1/2. The behaviour of 
Ti as a function of the temperature is plotted in the right panel of the same figure for 20 different sites. As expected, 
\ogTi{(3) grows linearly with f3 (with integer slope) at small enough temperature. The barriers bi, computed with 



A C implementation of the algorithm is available upon request to the authors. 
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FIG. 11: Monte Carlo study of a sample of size A'" = 10'', a = 0.6. Local correlation functions are measured by averaging 
over 2 ■ 10=* to 10^ runs depending on the temperature. Left: local correlation function Ci{t) for one spin, from left to right 
T = 1, T = 0.5, T = 0.3. Right: local correlation times Ti for 20 spins of the sample, defined as Ci(Ti) = 0.5. Bold solid 
lines correspond to Arrhenius law (I34II with 6^ = 1, 2, 3, 4. The symbols are chosen according to the computation of bi with the 
algorithm of Sec. IVI F1 7 sites have bi = 1, 7 bi — 2, 5 bi = 3 and 1 bi — 4. 




FIG. 12: The large scale part of the integrated distribution of barriers computed with Yannakakis algorithm. 



the algorithm of this Section, are in perfect agreement with the slopes. An interesting open problem would be the 
computation of the prefactor in the Arrhenius law, which might be related to the degeneracy of minimal barrier 
rearrangements. 

The example of Fig. ^| shows that the disjoint combination algorithm does not predict the correct barrier for 
a general tree^^. However balanced trees are quite special. The relevant question is whether for the random trees 
appearing in our model, the disjoint strategy yields in most cases the correct prediction. In particular we are interested 
in the critical limit a — s- a^- Is the large rearrangements divergence b — Tlog(ad — a) modified when barriers are 
computed adopting the exact Yannakakis strategy? 

Unfortunately, the intricate character of the cost functions in Yannakakis algorithm forbids an analytical study 
of the corresponding barrier distribution along the lines of Sees. IVI Dl and IVI El We thus resorted to a numerical 
computation of Q^'*'''^ by running the message passing algorithm described above on large samples. 

The distribution obtained in this way has the same qualitative behaviour as Qf^"^ (cf. Fig. |S1). As a ad, 

a plateau develops at « (f>d, whose length diverges at ad. The main consequence of passing from disjoint to 

Yannakakis strategy is a finite (as a — > ad) shift of the cumulative distributions towards smaller 6's. We plot in 
Fig. ElQb'*'''^ for several values of a as a function of 6 — 6o(a), where b'g = — Tlog(ad — a) is the typical size of 
large barriers within the disjoint strategy, cf Eq. (|61|l . The good collapse of the part of the curve under the plateau 
supports the claim that the disjoint strategy is asymptotically optimal as a — > ad and that the true barriers diverge 
indeed with the same law — Tlog(ad — a). Further numerical evidence of this claim will be discussed in Sec. IVI III 



On the other hand, it has been proved |6 J that the disjoint estimate is always within a factor 2 from the correct barrier. 
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G. Lower bound on the minimal barriers 



Starting from Sec. lVI we assumed so far that minimum barriers can be computed restricting to trajectories such 
that each spin is flipped at most once along any of them ('one-spin-flip' trajectories). The numerical data presented 
in the previous Section give some credibility to this hypothesis. If, on the other hand, the hypothesis were not correct, 
the calculations of the previous pages would only provide an upper bound on the barrier size. 

In this Section we will show that, removing this simplifying hypothesis, we can still construct a lower bound on the 
barrier size. As a consequence, we can control the error introduced by restricting to one-spin-flip trajectories. While 
the lower bound is not tight, it gives further support to the claim that the behavior b ~ — T log(Q!d — a) for the typical 
barrier of large scale rearrangements is indeed exact. 



We start by recalling that, as argued in Sec. II V Bl we can restrict ourselves to the case of a tree graph Q (eventually 
by considering a finite neighborhood of the site i). For simplicity of exposition, we shall first assume that the 
rearrangement Ri is fixed (later on we will have to optimize over Ri). As in Sec. IVII we can therefore focus on the 
problem of computing (a lower bound on) the energy barrier for flipping all the spins of an Ising model on a tree T 
rooted at i. Let cr be a configuration of such a model and E{a) the number of edges joining a plus and a minus spin 
in T (one half of the usual energy). The barrier bi was originally defined as the minimum over all the trajectories 
{(y(t)} joining the two ground states ct*^+^ and (T^"-*, of the maximum along the trajectory of E{a(t)). 

An equivalent (dual) definition can be obtained as follows. Let k : {±1}-^ — » {±1} be a function of the configuration 
a such that K(cr(+^) — +1 and k((T^~^) = —1. Furthermore, let 9k be the set of configurations a such that fi{a) — +1 
and k((7'^*^) = —1 for some i. Here a^'^ is the configuration obtained from a by flipping the i-th spin. It is easy to 
show that 

bi = max min E{a) . (62) 

In order to construct a lower bound on bi, we just need to exhibit a function k((t). Computing the minimum over 
a G dn is of course quite difficult for a generic function ^(cr). Our plan is to define /c((t) recursively, exploiting the tree 
structure of the graph. This will allow for a recursive evaluation of the minimum. More precisely, for each site j G T, 
we will introduce a function Kj{a) depending on the values of aj and its descendants. At any non-leaf sites i, Ki{a) 
will be defined as a function of {Kj(cr)}, with j running over the sons of i. For any leaf site j, we have tj(cr) = aj. 
At the end we set k(ct) = Ki{cr). 

We are left with the task of choosing the recursion which determines Ki in terms of the functions at its sons (to be 
denoted generically as j). A simple (but reasonably good choice) is Ki(cr) — M^j^O; ({Kj(cr)}), where 

^/l ^ \ 1 +1 if EiFO ^ ^ ~ 2r, , 

Mr,n(Ki, ■ • ■ ,K() = < , (63) 

1—1 otherwise. 

Here r is a non- negative integer and O a subset of {!,...,/}. The parameters rj, and the sets fij can be chosen in 
order to optimize the bound. They will depend on the tree T, but not on the configuration a. 

The lower bound on the barrier implied by this choice of the function k can be computed recursively. Let Tj be 
the subtree formed by j and its descendants. Denote by bj{+/—) the lower bound on the barrier for the subsystem 
Tj under the condition that aj = +/— (in other words, the minimum in Eq. (|62() is taken only over the configurations 
satisfying this condition). A moment of thought shows that 

b,{+) ^ n + min [6,(+), 6,(-) + l] , (64) 
hi-) = {n^ - n - 1) + min [b,{+) + 1, 6,(-)] , (65) 

J G' *i 

where = is the number of descendants of i which are involved in the definition of the function Ki{a). 

First notice that, by changing rj rij — rj — l for all the sites j S T,;, one changes bi{+) ^ bi{—). We can therefore 
assume, without loss of generality, that bi{+) < bi{—). In fact it is not necessary to keep track of all the information 
used in Eqs. (|64|) . H65I) . We let bi = min[6i(-|-), 6i(— )], and define 6i = ii bi{+) = bi{—) and = 1 otherwise. 

The optimal choice of the parameters r^'s is obtained as follows. Suppose Qi is given and let 6,nin,Oi ~ minjfej ; j e 
fli}. If Sj = 1 for all the j G Qi such that bj = &inin,r2i (in this case we will say that (5min,Oi = 1), then we set = [^J . 
In the opposite case (which we shall denote as (5min,Oi = 0), the optimal choice is — [ "'~"'" J . Using these choices in 
Eqs. (ESI) and (jHS), we get 



b„,i 



nt-l + S„ 




for Ui even, ^^^^ 
for Hi odd. 
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It is useful to notice that a natural order relation can be defined on the couples 5i). We will say that (6, S) ^ (&', 6') 
ii b < b' or b = b' and S < S'. It is simple to show that {bmin,nii ^min,ni) — niin{(6j, i5j) ; j € fli} if the minimum is 
taken with respect to this order relation. Furthermore, given rii, the mapping H66|l is monotonously increasing with 
respect to the same relation. We can therefore optimize over fli, at fixed rii as follows. First order the decendants 
of j by decreasing {bj,Sj). Then form Qi by retaining the first Ui items of this list. If the list of ordered couples is 
denoted as {(6[i], ^m); (^[2]: '^[2]); • ■ • }: then the optimized recursion is obtained by replacing 6[„.] to 6min,sii, and S[ni] 
to ^miiK^i in Eq. (|n6|l . We can finally optimize over rii to get 

, (l-5[„])I{neven} + 5[„]I{nodd}^ , (67) 

where h is the number of descendants of i, and the max is taken once more with respect to the order relation ^. 

As a simple application, one may consider the case of a fc-generations binary tree. We saw at the beginning of 
Sec. IVIFI that the disjoint combination strategy overestimate the barrier in this case by a multiplicative factor which 
approaches 2 as fc — > 00. If we call {bk,Sk) the values of bi and 5i at the root of such a tree Eq. 1)67(1 implies the 
following recursion: b^+i — bk + Sk, Sk+i = 1 — Sk- This in turns yields bk — \_k/2\ which is essentially tight. 

In applying the above method to the p-spin model we must consider the problem of optimizing over the 
rearrangement Ri. Once again, we exploit the fact that the mapping ((67|l is monotonously increasing with respect to 
the order relation ^. We can therefore construct recursively Ri also in this case. For each site j in Ri and interaction 
term a, at least one more site k adjacent to a must belong to Ri. In fact, it can be argued that the minimal barrier 
is achieved by simple rearrangements. We restrict to this case here: exactly one more site k (apart from j) belongs to 
Ri. This site can be chosen by minimizing {bk, Sk) with respect to this order relation. 

The whole procedure can of course be implemented in a message passing style. Messages UQ_,i and Vi^a sue now 
couples (&, S). They satisfy recursion relations of the form (|54l) . with /;( • ) being replaced by the mapping 1)6 7|) . Also 
the probabilistic analysis can be carried out along the lines of Sec. IVI Dl The only difference is that, due to the 
new degree of freedom S, one has to keep track of joint distributions Qs,b, with S = 0,1. The critical behavior of 
these distributions for a ^ ad is very close to the one obtained in Sec. IVI El within the disjoint strategy. The main 
difference is that the parameters uja and ujb are replaced by lo'^ and with lo'^^^^ — '2.L0a,b- As a consequence the lower 

bound on the typical barrier for large rearrangements is b\\j ~ — iTlog(ad — «)• Together with the disjoint strategy 
analysis, this provides a rigorous proof that b = 0{ — log(ad — a)). 

As stressed above, we do not think that the lower bound described in this Section is tight, even in the critical 
regime. It should be possible to improve it at the price of a more intricate recursive definition of the functions Ki[a) 
(in the definition used here, Kj(cr) depends only on the spins at the leaves of the rearrangement). On the other hand, 
it provides some support for the conjecture that the behavior b ~ — Tlog(Q;d — a) is asymptotically exact. 

VII. GEOMETRICAL PROPERTIES OF OPTIMAL REARRANGEMENTS 

In the previous Sections we studied two types of optimal rearrangements: minimal size, and minimal barrier 
ones. Several refined properties can be defined and studied. First of all, what is the trade off between the two 
criteria of optimality? For instance, how larger are the minimal barrier rearrangements compared to the minimal size 
ones? Moreover, thanks to the underlying Bethe lattice, some geometrical properties of the rearrangements can be 
introduced. For instance, one can study the distribution of the distances between the root of a rearrangement and 
the sites it contains. 

Finally, the diverging rearrangement size (and barrier) as a ad implies that dynamics becomes more and more 
cooperative in this regime. One possible characterization of correlations induced by the increasing cooperativity is 
the following. Consider a variable i and the minimal size of its rearrangements, n^. Imagine now that a very strong 
external field is applied on another variable j, preventing it from being flipped, and define as the minimal size 
of the rearrangements for i which exclude the frozen variable j. If the two variables are sufficiently far apart, this 
additional constraint will be irrelevant, and one will have nf ^ = rii. However if j gets closer to i, it may happen that 

j belonged to all optimal rearrangements for i, which will imply rSp > n^. How close the variables have to be for this 
to happen allows to define a "geometric correlation length" . We shall define a "geometric response function" related 
to the difference np^ — rii, and a susceptibilit y b y summ ing it over the positions i and j. This turns out to be a close 
analog of the four-point correlation function jl^ Iisl [l6j , used in studies of the structural glass transition. 

The above questions are considered in the rest of this Section. Let us briefly list the main results. The size of 
minimal barrier rearrangements diverges as (ad — a)~'^^'^" with non- universal exponent fbarr > v (recall that v is the 
analogous exponent for minimal size rearrangements). The typical distance between the root and a random node in 



(6. 



5i) — max I 6[, 

l<n<ii 
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FIG. 13: An example where minimal barrier rearrangements and minimal sizes ones are distinct. 



a large rearrangement diverges as (ad — ct)^^, with universal exponent ( = 1/2. Finally, the number of sites which 
are influential for the optimal rearrangements of site i (as measured through the above susceptibility) diverges as 
(ofd — a)~^ with universal exponent rj = 1. 



How large are minimal barrier rearrangements? Consider the simple example of Fig. ^1 The minimal barrier 
rearrangements for the site have barrier 1 and size 5 (one of them is obtained by flipping the variables 0, 1, 2, 3, 4 
in this order). On the contrary the minimal size rearrangements (for instance, the one formed by sites 0, 5, 6, 7) have 
barrier 2 and size 4. 

This example shows that minimal barrier rearrangements can be strictly larger that minimal size ones. It is however 
not clear whether the same remains true if we focus on the critical behavior as a ad ■ To keep the level of difficulty 
of the computations at an acceptable level, we compute barriers within the disjoint strategy, and assume it to be 
optimal in the critical regime. 

For a given site i, there can be several minimal barrier rearrangements of different sizes. We can resolve this 
ambiguity as follows. Distinct rearrangements with equal barrier occur because the choice of which spin to include at 
a given function node -i.e., the minimum in Eq. H54|l - can be degenerate. A random minimal barrier rearrangement 
can be sampled by removing such degeneracies, each time they occur, uniformly at random. We call rrii (to stress 
the difference with the minimal size n^) the average size of random minimal barrier rearrangements sampled in this 
manner. 

The computation of rrii can be performed recursively, exploiting the local tree structure of the graph Q. To this 
aim we supplement the messages Ua^i, Vi-,a used to computed the barrier 6^, cf. Eq. H54|l . with messages w'^^^, 
defined as rrii for the corresponding cavity graphs. For instance, v[^^ is the average size of the rearrangements of 
minimal barrier rooted at site i in the graph deprived of the interaction a. The new messages obey the following 
recursions: 



where Afa~*i is the number of sites j € da \ i such that = Ua~ti (in other words, the degeneracy of the minimum 

in Eq. (|54|l '). The sum in the second equation corresponds to an uniform average over the degeneracy at node a, as 
discussed above. Finally, we have 



A. Average size of minimal barrier rearrangements 




(68) 



j—' 




(69) 



Notice that this procedure is not equivalent to picking a rearrangement uniformy at random among the ones of minimal size. However, 
it is more convenient for calculations. We expect the critical behavior not to be affected by this choice. 
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For random hypergraphs, the above recursions acquire a distributional meaning. Note that the messages u and u' 
(or V and v') on the same link are correlated. As messages u' and v' can take non-integer values, we will define 

qb,mdm = F{vi^a = b,Vi^^ € [m, m + dm]} , (70) 

Analogously qb^m is the joint distribution of Ua^i and Marginalizing over m, one recovers the distributions 

studied in Sec. I VII J dm qb.m = qb- The explicit distributional equations read: 

oo ^ / 

qb,ni = "^Pl ^b,^,n, (^j, (fc^ , . . .,b, ) ^("1 - 1 - mi Ull), (71) 

1=0 bi,...M j = l 

[[dmj qb,m. Ql^^ dim ^ I . (72) 



fc=i ^ " ' " j=i 

Consider the partial averages Mb = J dm qb.m'ni and Alb — J dm qb,m'^- Notice that Mb/qb is the average size of 
minimal barrier rearrangements, conditioned on their barrier^^ h. Equations l|71(l . 1)72(1 imply 

'DC 

Mb = qb + ^Pil ^ Mb,qb.,...qb,Sf^j\(^bi^...M)' C^^) 

1 = 1 bi,...M 

Mb = Mb- . (74) 
% 

These equations can be solved numerically by iteration, we defer the detailed presentation of the method to App. IC 3l 
In Fig. 1141 we plot, for a few values of a approaching its critical value, the quantity Mb/qb as a function of b. 

Two scaling regimes can be distinguished. For barriers of intermediate size , b ~ log(Q!d ^ ol), the average size 

Mb/qb grows exponentially with b. In the large barrier regime b ~ — Tlog(ad — a), the size saturate at (Mb/qb) ^ 
(ad — a)~^^'^" . A careful asymptotic analysis reveals that 

2Wa 2uJb 

where iia/b are positive solutions of the equations 

(e'^+'^-l)(e-" + 6-^-6-"^-^) A 



(e/^ - l)(e'^ - 1) 2 



(76) 



with w = —ijJa (for /ia) and oj = uob (for /^f,). We obtain for instance z^barr ~ 2.0157 for p = 3 (cf. Table Hll for the other 
values of p), which is strictly larger than the exponent for minimal size rearrangements, v « 1.59379. 

Let us conclude by noticing that the "inverse" computation, namely computing the energy barrier for minimal size 
rearrangements, is technically more challenging. However we expect the result to be analogous to the one derived 
here: the barrier for minimal size rearrangements should diverge as — Tgizo log(Q!d — a) with Tgizo strictly larger than 
T. 



B. Average depth of minimal size rearrangements 

We turn now to a study of the shape of optimal rearrangements. We define the depth of a rearrangement Ri as the 
sum of the distances of the sites j € Ri from i. 

For a given graph C/, consider a site i with minimal rearrangement size n^, and call ti the average depth of 
its optimal rearrangements. With this definition, ti/rii is the average distance between i and sites in the optimal 
rearrangements for i. We shall call this quantity the "radius" of optimal rearrangements. 



To be more precise, the conditioning is on having an anchored barrier of b. This distinction does not change the critical behavior. 
Here the average is taken with the same procedure described in Sec. IVII Al Each time the minimum in Eq. I36i is degenerate, one of 
the optimal branches is chosen uniformly at random. 
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FIG. 14: The average size of minimal barrier rearrangements. From bottom to top, a — 0.7, 0.75, 0.8, 0.81, 0.814. 

Let us emphasize that in general rearrangements of same size but different depths can coexist. A simple example of 
this phenomenon is provided in Fig. 1151 Among the eight distinct optimal rearrangements (of size n — 4) for the root, 
four are of depth 5 (they include the left branch in the first interaction) and four of depth 6 (right branch). All of 
them are sampled with equal probability according to our procedure, therefore t — 11/2, and the radius is t/n ~ 11/8. 

As sketched in Fig. 1151 the quantity ti can be computed in a recursive manner: along with the minimal size messages 
Ua^i and Wi_+Q which verify the recursion equations H36|) . we introduce supplementary messages on every directed 
edge of the factor graph, u'^^^ and v'^^^. They are defined as U, but refer to cavity graphs. For instance, vl_^^ is 
the average depth of the optimal rearrangements rooted in i in the graph where the interaction a has been removed. 
They obey the recursions: 

where Ma—>i is the number of sites j £ da\i such that vj^a = Ua^i (the degeneracy of the minimum in Eq. H86|l V In 
the first equation, the term U/j^i arises because the distance of a descendant of i from the parent of i is larger than 
its distance from i by one. Finally the site quantity can be computed in terms of the incoming messages: 

U=Y^ [Ua,^^ + . (78) 

The reader is invited to check the correctness of this procedure on the example of Fig. 1151 

Until now the computation has been performed for a site i in a given sample Q. As in the previous Section, for a 
random graph C/, the distribution of ti can be determined from the joint law 

Qn^tdt^F {v^^c. ^ n, v'^^^ £ [t,t + dt]} . (79) 

Analogously, Qn.t will denote here the joint distribution of Ua^i and u'^_^^. Because of the memoryless property of 
Poisson random variables, qn,t is also the joint distribution of ni,ti. The recursion relations on the messages are easily 
translated into equations for q„.t and qn,t'- 

qn,t = X!^' X! / n '^^i 5n,i+m+---+ni 5{i - ni - ti ni - U) , (80) 

1=0 rii,...,ri( j = l 

in, = E In,,, S (t - !l±_±il) . (81) 

i— 1 ^ ^ J — 1 ^ ^ 

By definition Jdt qn.t — is the distribution of minimal sizes studied in Sec.^ Hence qn,t/qn is the distribution 
(with respect to the graph Q, and the site i) of the average depth t of optimal rearrangements, conditioned on their 
size n. For large scale rerrangements of diverging size in the critical limit a — > ad, we expect this law to have a scaling 
form 

q-nd/qyi ~ ("d - a)^ S{{ad - a)'^t \ (ad - a)''n} (82) 




E 

j£da\i 



(77) 



27 




FIG. 15: An example ol the computation of ti. The numbers on the left are the distances of the sites from the root. The value 
of the messages u,u' (resp. v,v') are indicated next to the edges from interactions to sites (resp. from sites to interactions). 
They verify the recursion equations 13611 and 17711 . 



For the sake of simplicity (and with the aim of determining the exponent ^) we shaU concentrate on the partial 
averages Tn = J dt tq^^t and T„ = / tqn,t- Hence T„/(nq„) is the average radius of optimal rearrangements of size 
n. Equations l|Sn|) and (|HT|l imply 

oo 

Tn = ^P/^ X! (Tni + '^'L(lni)(ln2 ■ ■ -(In, Sn,l+ni+--+n, , (83) 
l—l ni,...,ni 

f„ = Tn— . (84) 
To lighten the notation, let us define T„ = r„ + nqn- We finally obtain: 

r„ = apy^ qn^mfm , fn=Tn—+ Uq^ ■ (85) 

^ qn 

rn 

As was the case for the distribution the sequence r„ can be efficiently determined numerically by recursion on 
n, the initial value being Ti — 0. We present in Fig. 1161 the output of such a numerical computation. For clarity we 
plotted the average radius On — Tn/ {nqn) as a function of the size n. 

Its critical behavior can be determined analytically. The details of the computations are presented in App. IC 41 
As for the distribution of minimal sizes Qn, two scaling regimes can be determined. For intermediate sizes, n ~ 
(ofd — a)~^/^°, the radius grows like a power law of n. In the large size rearrangements regime, n ~ (ofd — a)"", the 
radius saturate at ~ (ctd — a)"'', where C = 1/2 is universal. This is consistent (as it should be) with the divergence 
of the point-to-set correlation length defined in Sec. 1111 Bl 

It is not hard to realize that the same scaling (ad — a)^^/"^ must hold for the radius of large minimal barrier 
rearrangements. This is in fact the radius below which optimal rearrangements on site i are insensitive to perturbations 
on other sites, see also next Section. It is also related to the number of iterations necessary for iterations of the form 
(|56|l to converge to their fixed point. 

For large rearrangements, eliminating the dependency upon a yields the scaling 0„ ~ n^/^''. This can be compared 
with the case of uniformly random trees, which can be interpreted as a mean field model for ordinary bond percolation. 
In this case it is well known js^ that On ~ n^/^. Since v > 1 always, large scale rearrangements are 'denser' than 
percolation cluster. 
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FIG. 16: The average radius 6„ in optimal rearrangements of size n, from bottom to top a — 0.8, 0.81, 0.815, Ofd. 




FIG. 17: A chain of r = 3 interactions for the computation of geometrical susceptibility. 

C. Geometrical susceptibility 

1. Minimal size rearrangements 



We turn now to the question of dynamical correlations induced by optimal rearrangements, cf. the discussion at the 
beginning of this Section. Consider the portion of a graph sketched in Fig. 1171 where we isolated the root site zq and 
a chain of r (r = 3 in the figure) sites «i, . . 



linked by interactions ai, . . . , a^- We define n^*'''' as the minimal size 



of rearrangements for iq which do not include the variable v (one can imagine that a pinning external field has been 
applied on thus preventing it from flipping) . This is to be compared with rii^ , the unconstrained minimal size of 
rearrangements for the root iq- The unconstrained size Uig can be computed through the message passing procedure 



described in Sec. which makes use of messages Ua^i 



and 



of the chain directed towards io, supplementary messages u'^^_^^^ 
chain bears the usual single message (either Ua-,i or Vi^a)- 

The unconstrained (resp. constrained) size is given as follows in terms of messages 



(i ) 

In order to compute , we introduce, for each edge 



The edges of the graph outside the 



/3ec3io\ai 



(86) 



While the messages Ua- 
we have: 



obey the usual relation H3()|) for minimal size rearrangements, for the new messages 



E 



/3e9ifc\{afc,afc + i} 



jedak\{ik,ik-l} 



(87) 



(88) 



Notice that these equations are formally identical to Eq. (|36|1 . The constraint of excluding v from rearrangements 

whose minimal size is 'ri[^j\ is enforced through the boundary condition Wj'^^q^ — oo. In this way, the variable ir is 
never included in the rearrangement. Equivalently 

jedaT-\{»T-,ir-l} 
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The two quantities riig and ni^J^ (as well as the messages Ua^i, u'^^^ or vi^cn are correlated, as both of 

them see the same "environment" . We must therefore keep track of the probability distributions 



P{i;,,^„, - n, v'.^^^ = n'} , (90) 



and the analogous one (denoted as (f^nP) ^'-"^ messages Ua^^-i^^i^, u^^^^^^^. Here probabilities are implicitly condi- 
tioned on the existence of a chain of interactions of length r between the root «o and the constrained site ir- Since 
the variable node degrees are Poisson random variables, the couple nig,n\J' is distributed according to q)^ l^,. We also 

define the cumulative distributions Q^n'^ and Q^^f^ ■ The first one is, for instance, the probability that Vi^^at > n 
and ^ij^ctj > n' . With these definitions, the distributional equations read 

Qnli' ~ Qn,n' Qma^{n,n') ' (^-'-) 



Inn' ~ y y ] y ] (Z^j'jj/^^mi ■ • ■ 9m, <^n,ni+miH \-mi ^n' .n'^+nii-\ hnii J (^2) 

;=0 ni,n'^ mi... ..mi 



where g„, g„ are the distributions of minimal size rearrangements, i.e. the solutions of Eqs. (|39|l . (|40|l . 

Let q^^)^^^ = 1n\' (respectively qnjmc = X)n' 1n\' ) ^^^^ marginal distribution of the constrained (uncon- 
strained^^) sizes. Define 

oi-r) = „(»•) _ ('qS'i 

■^n — yn.con yn,unc " V*^^/ 

The knowledge of si'"'* allows to compute the expectation of any observable of the form .fin'fj''^) — /{nig). For the sake 
of simplicity, we shall hereafter focus on this function, rather than solving Eqs. (|91|l . H92|l for the joint distribution of 

n'fjK 7ii„. Further justification for considering on this type of functions will be provided in the next Section. 

(r) 

Equations for Sn are more easily written by introducing the integrated version, 

^i") = E -i'' • (94) 

n' >n 

as well as the corresponding quantities for u-messages: Sn"^ and Sn \ From Eqs. (|91|l . H92|l . and using the recursion 
equations (|39|l . (|40|l . it is easy to obtain 

^ ~ y ^ ^n-nrblm i ' = ^ . (95) 

m 

(r) v-^ ^(t") 

Furthermore, the first of these equations can be rewritten in terms of integrated sequences as Sn = z2m ^n~m1m, 
cf. Add. IC 5 a1 

For r — one has by definition Sn^ = 1 — Q„ . Equations (|95|l can be used to compute Sn'' efficiently by recursion 
(both on n and r). We show the results in Fig.^1 left panel, for a = 0.8 and a few increasing values of r. As n ^ oo, 

(r) 

S'n 1 if r = 0, (we are constraining the spin cr^g itself not to be flipped: there is no rearrangement of finite size 

(r) (r) 

satisfying such a condition), and S'n ^ if r > 1. Moreover one can clearly see S'„ ^ as r — > cx) at fixed n. 



Indeed the constraint of not hipping ctj^ gets less and less relevant in this limit, and when r is much larger than the 
typical depth of the rearrangements riig « '^'q'^^- From the studies of the depth of the rearrangements, one expects 
that the values of r where the constraint becomes irrelevant scales like (ad — a)^^^^ in the critical limit. 

(r) 

Let us now define a susceptibility Sn by summing the above "response function" Sn over the position of the 
constrained site. As there are on average {ap{p — 1)Y sites at distance r of the root, we have 



^iap{p-l)YSl:K (96) 



E 

r=0 



1^ Note that the marginal distribution of unconstrained minimal sizes gnj^nc = En' In ii' distinct from In fact, in gi'^unci we 
condition on the existence of a chain of length r from the root. 
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FIG. 18: Left: the r6spoiis6 15*71, of the minimal rearrangement size distribution to a constraint on a site at distance r of the 
root. We used oi = 0.8 and, from top to bottom, r = 0, 1, . . . , 5. Right: the corresponding susceptibility Sn- From left to right, 
a = 0.8,0.81,0.812. 



We also define S'„ = X]r>i("^P(P~ l)YSn^ . Intuitively, Sn is a measure of the "spine" of optimal rearrangements of 
size n. By spine, we mean the subset of sites which belong to all of the optimal rearrangements for i. 
From Eq. (|^ . we get 

Sn = 1 - Qn + ^ Sn^rnQm , Sn = ap{p - l)QP^^Sn ■ (97) 
m 

The numerical solution of these equations is shown in the right panel of Fig. 1181 for a few values of a approaching a^. 
The behavior of these curves is strikin gly similar to the one of the four point susceptibility close to the mode coupling 
transition in structural glasses [T^ lla ll5llT6l| . Here n plays the role of time in MCT, and a that of the temperature. 
For a given value of a, the spine size has a maximum S^{a) which corresponds to rearrangements of total size ^^^(q;). 
When a — > ad both n.^,(a) and S.^,{a) diverge. 

An analytical study of the asymptotic behavior, cf. App. IC 5 al confirms this remark. The main result is that 
n*(a) ~ (ad — a)"" scales as the typical size of large scale rearrangements, while ^^(a) ~ (ad — a)"'', with an 
universal value rj — I. The same critical behavior was recently found for the for the four point susceptibility of the 
fully-connected p-spin model, as well as in MCT jl^ • 



2. Minimal barrier rearrangements 

A geometric susceptibility can be similarly defined in terms of minimal barrier rearrangements. In this context, 
is the minimal barrier of a rearrangement for the variable io which excludes v, another variable at distance r 
from ig. To simplify the analysis, we consider barriers obtained from the disjoint strategy. While exact barriers can 
only be computed through Yannakakis approach, we expect this simplification not to alter the critical behavior. 

Following the same steps as in the previous Section, one is lead to define a function S^ . This is the response of 
the minimum barrier distribution for site ip, to a perturbation applied on site ir- Using Arrhenius law, it is easy to 
establish the relationship between S^^ and physical observables. Assume that an external field h has been applied to 
site ir at distance r from iq. Let C^^\t;h) the expected (with respect to the graph Q) local correlation function for 
spin (TiQ, under the (equilibrium) modified Glauber dynamics. The response x'-'^^(t) = C^''-' (<; cx)) — C'-''-'(i;0) is given, 
in the low temperature limit, by 

\unx^^He''') = sll], (98) 

which generalizes to susceptibilities the relation (|47|l between barriers distributions and correlation functions. Unlike 
usual response functions (in which the external perturbation is infinitesimal), x^'^HO ^he response to an infinite, 
but localized perturbing field. Since in any case x^^\t) ^ as r — > oo, this difference should be immaterial for the 
critical behavior. 

(r) 

Summing S^ over the perturbation site v, one can define a barrier susceptibility Sb- Proceeding as in the previous 
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FIG. 19: Geometric susceptibility for minimal barrier rearrangements. From left to right, a = 0.816, 0.818, 0.8184, 0.81846. 
Section, one can derive a set of coupled equations which determine St'- 

oo 

Sb = l~Qb + ^Pi ^ Sboqbi---qbiKb< fi+i{bo,...,bi)) , (99) 

(=0 bo,...,b, 

Sb = ap{p-l)Qr^Sb . (100) 

These are the counterpart of Eqs. (|97(l for size susceptibihties. 

A numerical solution of these equations, cf. App. IC 5 bl leads to the result shown in Fig. E| As for the size 
susceptibility Sn , the behavior of its barrier analog Sb is very close to the one of the four point dynamical susceptibility 
in MCT. The barrier height plays the role of time, and in fact they are related through Arrhcnius law in the low 
temperature limit, cf. Eq. (|98|l . The maximum of Sb corresponds to large scale barriers b^{a) ~ — Tlog(Q;d — a). Its 
height diverges at the dynamical transition St,{a) ^ (ad ~ ck) with the same universal value rj = 1. The details of 
this analytic study can be found in App. IC 5 bl 

VIII. SCALING ANALYSIS AND NUMERICAL EXPERIMENTS 

In the last Sections we focused on the zero temperature limit at a < ad. Here we shall discuss the implications of 
these results on the finite temperature behavior. 

In order to simplify our discussion, we take a step back and focus on the global relaxation time r = r(/3, a). This 
is defined from the global correlation function through the condition C{t) = 5. Most of the arguments below can 
be easily transposed to local times. 

In the low temperature, a < ad regime, Arrhcnius law yields r ^ exp(2/35iargo), where 5iargo is the typical minimal 
barrier for large rearrangements. Substituting the critical behavior of 6iargc, we get 

T(/3,a)~(ad-a)-2^^. (101) 

This relation is valid if a ^ ad after (3 — » oo. On the other hand, at any (3 < oo, the relaxation time does not diverge 
at a = ad, but at a somewhat higher value of a corresponding to the dynamical line, cf. Fig.^ 

r(/3,a)~(ad(/3)-a)-^(''). (102) 

Equivalently, r(/3,a) - (T - Td(a))"'^^"\ In Sec. 177771 we derived a lower bound of this form implying 7( • ) > 1/2. 

Let now T = 1//3 be some fixed small temperature, and consider the behavior of r(/3, a) as a is increased towards 
ad and above. We expect that pOlfl remains true as long as a is not too close to ad. Near ad the divergence is 
rounded off, and eventually a crossover to the behavior (|102|l takes place. In other words, the dynamics crosses over 



As for local relaxaton times, cf. Sec. 1111 Cl the precise value of S is irrelevant, as long as it is smaller than the global Edwards Anderson 
parameter. Note also that the relaxation time t introduced here should not be confused with other global time scales, such as the 
inverse spectral gap, or the mixing time. 
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FIG. 20: Left: Global correlation times, as defined from the correlation function through the relation C(r) = 1/2. Right: 
Scaling plot of the same data. Notice that no fitting parameter is used here. 



from an "activated regime" , i.e. a regime for which Eq. H1U1|) is accurate, to a "thermal" regime in which Eq. H1U2|) 
holds. 

At which values of a does the crossover takes place? We will produce two distinct heuristic arguments that provide 
the same answer. The first one is very simple. The divergence (|101() is rounded off only if (ad(/3) — a) is significantly 
different from (ad — a). Equivalently, (ad — a) ~ {ad{f3) — ad). On the other hand a cavity computation, cf. Add. IdI 
shows that, as /? ^ oo, 

ad(/3) =ad + Xde-^'' + o(e-2'3), (103) 

with a;d a finite, p-dependent constant. Therefore, the crossover regime corresponds to (ad — a)e^^ — 0{1). 

The second heuristic argument is more involved, but more instructive. A finite temperature configuration can be 
characterized through the locations of energy defects, i.e. frustrated interactions. In a low temperature equilibrium 
configuration, these defects are very sparse, and their density is about e~^^ (as long as a < ad). Consider now 
a spin (Ji, and the associated minimal barrier rearrangement Ri of size Ui and barrier bi. Glauber dynamics will 
make use of energy defects in order to accelerate the relaxation of Ci, with respect to the purely activated behavior 
exp(2/36i). A rough intuition of this phenomenon is obtained by assuming that interactions containing an energy 
defect can be removed from the system. A first remark is that, as long as nie~'^^ ^ 1, no energy defect is encountered 
along the activated path (also allowing for slightly sub-optimal rearrangements). Arrhenius behavior exp(2/36i) 
is therefore not modified. Focusing on large rearrangements, this implies that Eq. (|101|1 remains correct as long as 
(ad - ay^^-e-^^ < 1 (i.e. ad - a > e-^^^"^-^"). 

This simple minded argument can be refined. We expect an energy defect to be as effective in reducing the effective 
barrier seen by spin ctj, as a pinning field is in augmenting it. In other words, the density of such defects must be 
compared to the size of the large rearragements spine (i.e. to the peak of the geometric susceptibility), rather than 
to their overall size. Using the results of Sec. IVII C 21 we conclude once again that the crossover regime corresponds 
to (ad-a)e2/' = C'(l). 

What is the behavior of t(/3, a) in the crossover regime? Inspired by the anomalous dynamical scaling for diluted 
ferromagnets at the percolation transition we conjecture the scaling form^^ 

T(/3,a) ~e2^^'/:((a-ad)e2/3). (104) 
In order to match Eqs. (|101|) and (|102|l . the scaling function €{■) must have the following asymptotic behaviors 

as X ^ — oo, (105) 
as a; ^ Xd, (106) 



C{x) ^ exp|--T(log|x|)2 
C(x) - (xd-x)-^^ 



^"^ The differences with respect to the form in Ref. I25l are due to a different normalization of the temperature. 
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FIG. 21; Super-Arrhenius behavior of the global correlation time at the critical average degree a = Od, for p = ?>. The dashed 
line represent the theoretical prediction r(/3, Qd) = Ae^"^^ , with A = 0.45 to fit the data. 



where 7d = lim_a^oo 

We carried out extensive numerical simulations in order to check this scahng hypothesis, along the lines exposed in 
Sec. lVI F1 In Fig. 1201 left frame, we reproduce the resulting global correlation time for several values of (3 as functions 
of a. In Fig. |2ni right frame, we check Eq. H1U4|) by plotting r(/3, a), in rescaled units, for several values of (3 and 
a. Despite the variation of the relaxation time over several orders of magnitude, an acceptable agreement is found. 
Remarkably, Eq. (|104|l predicts a super- Arrhenius divergence at this value of a: T{f3,ad) ~ 2T/3^. The prediction is 
well verified by numerical data, cf. Fig. 1211 thus supporting the hypothesis made in computing T, cf. Sec. IVII 

While the numerical results do not prove unambiguously Eq. H104f) . they support it as a valid working hypothesis. 
As in the case of diluted ferromagnets, Eq. H1U4|) is consistent with temperature being a relevant perturbation (in 
renormalization group sense) at the critical point (a = ad^T = 0). This in turns suggests that the line T = T^i^a) is 
ruled by a different universality class with respect to this point. 



IX. CONCLUSION 



In Section III Al we stressed that the critical dynamics of Bcthc lattice models was understood only in the fully 
connected a — > oo limit. In the previous pages we derived several results concerning the opposite limit T — > 0, 
a ad- We can now leverage on the knowledge concerning these two extremal points, in order to propose a complete 
scenario for the whole dynamical line {a,Td{a)). 

We found two universality classes"'^^ which correspond to distinct divergences of the slow time scale: 

• Usual mode coupling theory (MCT) holds at the a = oo point. The relaxation time divergence is as summarized 
in Eqs. (|32|l . (|33|l . The parameter Amct depends (continuously) on the model, and the critical exponent 7inct is, 
in general, irrational. 

• Activated mode coupling theory (aMCT) describes the T ^ 0, a ^ (with (ad — a)e^'^ ^ 1) behavior. The 
relaxation time diverges as in H101() . with T determined by equations of the form H58|l . (|60|l . and H61() . Once 
again, A depends continuously on the model, and T is, in general, irrational. 

On the other hand, several important elements are common to the two universality classes. Among the others, the 
linear size of cooperative regions scales as S^'^, and the peak of the dynamical susceptibility as S~^, with ^ = 1/2 and 
rj = 1 (here S ^ T — Td for the first class, and S = Ud — a for the second) [T^. 

In Sec. IVllH we argued that temperature is a relevant perturbation at the (a = ad,r = 0) point. It is therefore 
natural to guess that the whole a > ad, T — Td{a) is controlled by the ordinary MCT class. Namely, there exist a 
continuous function Amct (a) 7 such that the slow time scales behaves as in Eqs. (I32|l . (|33f) . The crossover away from 
the (a = ttd , r = 0) point is described by Eq. (|104|l . Finally the cooperativity exponents ^ = 1/2 and 77 = 1 remain 
constant on the whole line, as well as in the crossover regime. 



We use the term "universality" despite its content is not as clear in the present context as it is for ordinary critical phenomena. 
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At any finite temperature, usual MCT behavior eventually overcomes aMCT when the system is close enough to 
the dynamical line. On the other hand, activation can be important in a large pre-asymptotic regime, depending on 
the way the dynamical line is approached. Such a regime can be of experimental interest. 

In the model studied in this paper, the crossover is controlled by the scaling variable x ~ {a^ — a)e'^^ . This 
can be interpreted as the ratio between two diverging sizes at the [a — aci,T — 0) point: the spine of large scale 
rearrangements, which scales as (ad — ct)^^, and the inverse density of energy defects scaling as e^^. In terms of 
observable quantities, we could have written x = T^Cx/xh where Ct = dT{E{a)) is the system specific heat, and xX 
is the peak value of the dynamical four point susceptibility. In more general (non-mean field) systems, the same role 
is likely to be played by a ratio of the form x = ^th/?4- Here ^th is a thermal correlation length, and ^4 is a dynamical 
correlation length extracted from four point dynamical correlations. A similar scaling variable describes the crossover 
in diluted ferromagnets at the percolation point |62l |. 

The methods developed in this paper can certainly be applied in a more general context. In particular, rear- 
rangements can be defined for kinetically constrained models (Kob- Andersen, Frederickson- Andersen for instance) on 
Bcthe lattices, and studied along the same lines 0. Interestingly, a recent numerical study has investigated the 
relaxation time divergence in these models and indicates a behavior of the type t ^ (pd — p)~'^ [p being the particle 
density). 

As we mentioned in the Introduction, the problem studied here is known in computer science as XORSAT, and is a 
simple example in the wider family of random Constraint Satisfaction Problems 50]. The dynamical glass transition, 
essentially studied in this context at zero temperature as a "clustering transition" of the groundstates, is a feature 
shared by other examples of this family. Satisfiability and Coloring in particular [H^ • It would be of great interest 
to extend the refined decription of the changes in the landscape properties at the clustering transition we obtained in 
the XORSAT problem to these other models. 
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APPENDIX A: PROPERTIES OF THE EQUILIBRIUM DISTRIBUTION 

We prove here the statements {i) and (ii) made in Section III Al In order to prove (i), notice that the partition 
function admits the usual high temperature expansion 



Zjv,/3(J) = 2^e-^^^(cosh/3)*'^ 1 1 + H e(w)(tanh/3)l"l \ , (Al) 



where the (finite) sum over uj runs over all the hyperloops in Q. \uj\ denotes the size of the hyperloop u; and e(uj) the 
product of the signs of the interactions in it. If no hyperloop is present, only the first term survives. 

Consider now (m). Let P( J) be the distribution of the sign of the quenched couplings, i.e. the uniform distribution 
over { Jij...i e {-|-1,— 1} }, and P((t|J) the Boltzmann distribution for the configuration cr, given the couplings J. 
Sampling J from P(J) and then a from the conditional distribution P(cr| J) is equivalent to sampling from the joint 
distribution 

P(J)P((7|J) =P(cr, J). (A2) 

Using the form of the Boltzmann distribution, we have 

g-Af/3 

This is in turn equivalent to sampling a form the marginal distribution P(cr) and then J from the conditional distribu- 
tion P(J|(t). We are left with the task of determining these distributions. Using the definition of marginal distribution, 
and the fact {i) above, we get 

P(.).En^^^)= 2^(2eosh/3)M n E^'^^— (A4) 
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i.e. the marginal distribution of a is uniform. We can now apply the definition of Bayes theorem to get 



which proves our claim. 



APPENDIX B: CORRELATIONS 



This Appendix contains the technical details of the calculation of equilibrium correlation functions presented in 
Section irni 

1. n-point correlation functions: zero-temperature potential 

We start by computing the annealed potential By taking expectation with respect to the graph Q, and the 

constrained spins (but not on their number), it is elementary to obtain 

Na 

{1-coy. (Bi) 



1 + (1 - 2uj)P 



Here the sum runs over ui — 0,1/N,2/N, . . . ,1. Let us define the annealed potential at size N as V'ann(A;Af) = 
A^^^E; log2 ELKgZg{L)]. By a standard saddle point calculation, we get 

V'an„(A; N) = V^ann(A) + ^ViJ?n(A) + 0{N-') , (B2) 

cua) ^ 4^"g-['^'^-*)'--(^--)] + 2(iog2)^(i-l)^in-K)r ^^'^ 

Here Fx{uj) is the function maximized in Eq. (|10() and cj* is the point realizing the maximmn. As A ^ 0, we have 

V-inUA) =CiA + 0(A2). 

As claimed in Sec. IHII given e > 0, ipgiX) < V'ann(A) + eX^ for any A > with high probability. Let us stress that 
this statement is stronger than saying that, given e, A > 0, ipg{X) < V'ann(A) +eA^ with high probability. On the other 
hand, it is required in order to estimate the derivatives of ipglX). It can be proved by distinguishing two regimes (here 
1/2 < fc < 1): A < CN-'' and A > CN'^. In the first regime, the term (1 — w)' in Eq. ljBl|) can be replaced by 2 K 
The relative error is of order {lu - 1/2)1 - N~^/^ ■ N^-'', yielding ELEgZg{L) = 2^(i-")-' [1 + 0{N^^^-'')]. Since 
Zg{L) is a power of 2 by definition, the probability that Zg{L) > 2^(1-")-' is at most 0{N^'^^'') (recall that Na is 
an integer). The desired result is obtained by taking expectation with respect to I. 

In the second regime, we apply Markov inequality to the random variable Zg{L) (here we condition on a typical 
value ofi^NX): 

P{^e(A) > Vann(A) +eA2} < 2{-^[Vw„(A)+eA^-JV-Mog,E,EgZs(L)]} (g4) 

The term N^^KLEgZg{L) can be safely estimated by V'ann(A; N) (deviations of i/N from A being exponentially rare). 
The right hand side of the above expression is therefore (neglecting small error terms) 2^~^[^'^^~^ '''4>in„W+o(N ^)]}^ 
For any finite (as iV 00) A, iV-Vinn(A) < eA^. If A ^ (but A > CN-'') iV" Vinn(A) - N'^X < eX^. Therefore 
the probability that ipg{X) > ■!/'ann(A) + eA^ is exponentially small. 

In Fig. [55] we plot the function F\{uj) for p = 3, A = and a few values of a. For a < ckann ~ 0.889493, Fq{u!) has 
a global maximum at cj = 1/2 with Fo{u!) = 1 — a — ^{2u! — 1)^ + 0{{2uj — 1)"^) in its neighborhood. This implies the 
expansion The same is not true for a > aann because a second local maximum at < 1/2 overcomes the first. 

The value of ipg (A) in the thermodynamic limit can be computed through the cavity method. Alternatively, one 
can use a leaf-removal argument in the spirit^^ of Refs. [s^,!^- We get 



V'(A) = sup {-a + pa{l - x)xP ^ + ax^ + e:x.p[- X - pax^ ^]} . (B5) 

x&[0.1] 



We also refer to lei lei for an analysis of this algorithm on graph ensembles with general degree distributions. The results of 
include Eq. JEsJ. 
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FIG. 22: The function Fxiuj) (cf. Eq. lESl) for A = 0, and from bottom to top a = 0.8, a = Oann ~ 0.889493 and a = 0.95. 




FIG. 23: Portion of the factor graph for the p = 3 modeL Dashed hnes indicated other parts of the graph not represented here. 



For a < etc and A = 0, the sup is realized at x = 0. A straigthforward calculation yields 



dA 



dV 
dA2 



(B6) 



in agrement with the rigorous bounds (|12|) . Higher derivatives can be computed as well and are finite for any a < ad- 
In particular, the third derivative is easily seen to be related to the three points susceptibility xf*^, in analogy with 
Eq. (|5J. Under the assumption that the limits — > oo and A ^ can be interchanged, this implies the finiteness of 



Xn% for T = 0, a < ad and n < 3. 



2. n-point correlation functions: cavity argument 

The argument of the previous Section could be generalized to finite temperature using the Franz-Parisi quenched 
potential [3|- A more direct calculation consists in computing the correlation functions {ai^ ■ ■ ■ cri„)c using the cavity 
method. 

In order to simplify the exposition, consider the three-points function {aiajGk) for p = i. Generalizing to the 
computation of connected correlation functions as well as to other values of n and p should be straightforward. As 
a further simplification, consider the example in Fig. 1231 and i = 1, j = 3, fc = 4. The one-step replica symmetry 
breaking (IRSB) cavity expression for {(iia^ai) reads 

/ Z{^{J ^cav{/i,r(aia3a4)^^;>dpi(/ii)...dp5(/i5)|dQ[pi]---dQ[p5]. (B7) 
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Here m is Parisi IRSB parameter, 



CTlCT3Cr4>ia;^ = ^-TT X! ^1^3CT4 exp{-/3i/cav({crj}; {/l,})} , (B8) 



Zce.v{K} = ^exp{-/3ifcav({ff»};{/l»})}, (B9) 

5 

^^cavCjci}; {/li}) = -JaCri<J2(^3 ^ JpC^zCJia^ - ^ hiUi , (BIO) 



and Z{{pi}) = J Zcav{hi}'^dpi{hi) ■ ■ ■ dp5(/i5). Finally Q[p] is the IRSB spin glass order parameter, i.e. a distribution 
over the space of symmetric distributions on R: p{h) = p{—h). 

If m = 1 (which is the case for T > Tc(a)), these expressions simplify remarkably. One can in fact integrate 
explicitly over the {hi}. Since pi is symmetric, / dpi{hi) e^'^''^' does not depend on ai. The espression in curly 
brackets in Eq. (|B7|) is therefore given by 
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|...| = ^^^^3^4e-/3^^cav(K};{0}) -Q h2coshph,)dp,{h,). (Bll) 

W,} ^=l•' 

An analogous expression holds for Z{{pi}). Taking the ratio and integrating over Q{pi), we get the final result 

(aiagai) = {aia3rJ4)i"Jr ■ (B12) 

Notice that the cavity fields on the right hand side are set to 0. In particular, for the case at hand {aiasa^} — 0. 
More generally {(JiCrjCFk) is different from only if fc are connected by an interaction —Jaiajak- In this case we 
get {aiajak) = tanh/3J. Proceding analogously, one can show that {ai) = and therefore {uiUjCTk) = {ai(7jak)c- 
Summing over all the triples we find that, in the thermodynamic limit, 

= 6Q(tanh/3)^ (B13) 

for any a < ac- Proceeding analogously, one can compute higher order susceptibilities xfi'^ fo'' ^-ny finite n. 

3. Point-to-set correlation functions at finite T 

In this Appendix we explain how to compute the point-to-set correlation length ^*(e) and show that it diverges 
at T(i(a). Recall that the dynamical transition is usually defined using the following equations (one-step replica 
symmetry breaking with Parisi parameter m) 

P^ih) = , f n , '"'^^/"^ Hh-u, uO, (B14) 

Z{{pa.};m)J AJ. \UL=i cosh Pua. J 

Pa{u) = / ]^dpi(/lj)J(w-u(/li.../lp_i)) , (B15) 

i=l 

where u{hi . . . hp^i) = ■|atanh[tanh/3tanh/3ft,i • • • tanh/3/ip_i]. The fields distributions pi{ ■ ) and pa{ ■ ) are required 
to be symmetric. The indices i and a refer to nodes in the factor graph. When a random factor graph is considered, 
{pi{-)} and {pa{-)} become i.i.d. with common distributions (respectively) Q and Q, and / becomes a Poisson 
random variable with mean pa. The above equations acquire a distributional meaning. rd(a) is defined as the largest 
temperature such that a non-trivial solution exists for these distributional equations with m = 1. 

Using the symmetry of pa{ ■ ), it is easy to show that Z{m) = 1 for m = 1. We can therefore average over {pi{ ■ )} 
and {pa{ ■ )}• If we call, respectively Q{ ■ ) and Q{ ■ ) the average distributions, we get 

Q{h) = ± e--M / Yl AQ{u.^) f ^/"^^" ] Hh-u, , (B16) 

7^0 ^- J ail vnL=icosh/3u,; 

Q{u) = J l[dQihi)5{u-u{hi...hp^i)) . (B17) 
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Consider now the calculation of the point-to-set correlation length First notice that, within the high temper- 

ature phase the cavity fields vanish identically. This means that an equilibrium configuration within a neighborhood 
of a site i can be constructed as follows. First fix a.; G {+1, — f } uniformly at random. Then for any of the interaction 
terms involving cr,;, let us say —JuiGi-^ ■ ■ ■ <Ji^_-^ , generate the other spins from the distribution 

pj{a^,,...,a^^_,\a,) = 2^-1 cosh /3 J {(^•^'^i^^i ' '•^^p-i} ■ (^18) 

Then repeat the same operation with those neigbors of spins ii, . . . ,ip-i (as well as of the other neighbors of i), 
which have not yet been fixed. Repeat recursively until all the spins within a distance £ from i are determined. This 
procedure is well defined, because the factor graph is a tree within any fixed distance from i. 

Notice that, in order to generate the values of the spins adjacent to cr.;, we did not need to know the graph structure 
at any distance from i larger than 1. As a consequence, a random graph and a thermalized configuration for that 
graph can be generated jointly as follows (in the thermodynamic limit). First generate the degree I of site i from a 
Poisson distribution with parameter pa. Then generate the values of the spins which interact with ai, according with 
the rule given above. Repeat the same operation for the {p— 1)1 neighbors of «, and continue recursively for any fixed 
distance £. 

This gives a procedure for constructing the reference configuration cr'-^-' in our definition of £*{e), cf. Eq. H22|l . 
The recursive nature of this procedure allows for a recursive calculation of £*(e). Condition now on the event that 
(jf^ — a €z {+1, —1} and constrain a copy of the system to have spin crj'^'' at site j, for any j whose distance from i 
is at least £. Let h be the effective field acting on site i under this boundary conditions. This is of course a random 
quantity, because the reference configuration as well as the underlying graph are random. Denote by (h) its 
distribution, and by Pa^\h) its distribution under the condition that the degree of i is exactly 1. Then, it is easy to 
derive the recursions (here we assume, for the sake of simplicity, Ja = +1, and use the shorthand p(- • • |-) — P+i(- ■ • |')) 

pa (P")' 



P^ih) = ^e-^"^^ / l[dPi'\u.)6{h-u, , (B19) 

/=0 ■ •' a=l 

H'Hu) = P{<^l■■■'^p-lW)JlldPt'^ih^)Siu~u{h,...hp_,)), (B20) 

ai...(7p-i i—1 

which hold for any £ > 0, together with the boundary condition 

P^°^h) = Sih - aoo) , P^°^u)^S{u^aoo). (B21) 

These recursions can be easily approximated numerically using the population dynamics algorithm of 0. Notice 
that, by construction, P+{h) = P^[—h) and P+{u) = P-{—u) and therefore a unique population need to be tracked. 
Furthermore, the recursion preserves the following property 

The point-to-set length scale ■^♦(e) can be estimated by computing the quantity (here Eg denotes expectation with 
respect to the sample realization) 

Ec;E^(o) [af^ = j dpf ^ {h) tanh (ih . (B23) 

The data shown in Fig. 0] have been obtained using this approach. 

At high enough temperature, the iteration (|B19|) . (|B20I) converges to the trivial fixed point P+{h) = P-{h) — S{h). 

As the temperature is lowered, the convergence becomes slower and slower, and the plot of EgE^(o) (cri)^] develops 
a plateau as a function of £. Eventually, the iteration converges to a non-trivial fixed point of Eqs. (|B19|) . (|B20|) . let 
us denote it by P*{h), P*{u). Exploiting the property ljB22|l we can rewrite the fixed point distributions as 

with P( • ) and P( • ) two symmetric distributions. Rewriting the fixed point condition, cf. Eq. (|B19p . ljB20p in terms 
of P( • ) and P{-), we recover the IRSB equations (jB16ll . (jB17p . We thus proved that the existence of a non trivial 
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fixed point for the IRSB equations is equivalent to the existence of a non trivial fixed point for the recursion ljB19|l . 
(jB20|) . Under the assumption that, as soon as such a fixed point appears Pa^\ ■ ) converges to it^°, we thus proved 
that 4(e) = oo for T < Td(a). 

APPENDIX C: ASYMPTOTIA 

In this series of Appendices we shall work out the rearrangement critical behavior, i.e. both at a = ad and as 
a t ctd- Throughout these Appendices 6 = — a will denote the distance to the critical point. 

Before embarking in the calculations, it is interesting to draw some parallels with the analytical treatment of the 
schematic MCT model, and to collect technical properties we shall use in the following. 

The time correlation function C(r) of the schematic MCT (or of a fully-connected spherical spin-glass model at 
high temperature) obeys an equation of the form 

C{t) = -C(t) + /"dr' M(t - r')C(T') , (CI) 

where the memory kernel is a polynomial of the correlation function itself, M(t) = V{C{t)). These two equations 
share some features with the ones governing the distribution of minimal size rearrangements, cf. Eqs. (|39|l . (|40|) : the 
first one is a convolution on r (resp. on n), the second a polynomial relation between M(r) and C(t) (resp. between 
Qn and Qn)- In both situations, one of the equations is simple in the "direct space" of t or n, the other being simpler 
in Laplace transform (or generating function, see below). 

As for MCT, the study of Qn (and similar quantities) in the critical regime, can be carried out in three steps. 
First, one considers its decay exactly at the critical point, with n (or r) fixed. In a second step, one identifies an 
"intermediate regime" which describes Q„ around its plateau value. Matching these two regimes yields the scale of 
n in the intermediate regime. The "final regime" describing the decay of Qn from its plateau to zero can also be 
described by a scaling function. Again, the corresponding scale of n is derived through a matching argument. 

Given a function a(t) defined for t > 0, the corresponding Laplace transform will be denoted as 

poo 

l[a]{y) = / a{t)e-y' dt . (C2) 



"'0 

The equivalent of Laplace transform for discrete variables is given by generating functions (g.f.). We refer to [6^l6^l63 | 
for an extensive introduction to generating functions and asymptotic combinatorics methods, and recall here a few 
basic definitions. Given a sequence a„ defined for n = 1, 2, . . . , the associated g.f. is the formal power series 

oo 

gf[a](x) = ^a„x" . (C3) 

n=l 

As for Laplace transform, convolutions of discrete sequences translates into products of the corresponding generating 
functions. We shall sometimes introduce (right) partial sums of a sequence, denoted with the same upper-case letter: 



An^J2 ■ (C4) 



n' —n 



The corresponding g.f. / — gf [a] and F = gf [^] are then related by 

fix) = ^Fix)+A, . (C5) 

X 

The asymptotic behavior of a function shows up in the singularities of its Laplace transform. For instance, if 
a{t) ~ At^ when t — > oo, then 

L[a]{y) ^AT{1 + fijy-'-'^ + a,,,{y) , (C6) 



A proof of this assumption in a similar problem, due to J. Martin and E. Mossel, is reported in Ref. |41| . 
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where areg(y) denotes a function having milder singularities than y~^~^ at y — > 0. A formally identical formula holds 
when a(t) At^ when i ^ (in this case one has to look at y ^ oo). 

Similar relations holds for generating functions. If a„ ~ ^ for large n, then the associated generating function 
behaves as follows near x ~ 1: 

gf[a](a;) =AT{1 + - x)-^-^ + a,,g{x) . (C7) 



1. Minimal size rearrangements 

Throughout this Section, we shall denote by f{x) (respectively f{x)) the generating function of the distribution g„ 
(resp. qn) of rearrangements minimal sizes. With this notation, Eq. (|39|l can be written as 

f{x) — X exp { — pa + paf{x)} . (C8) 



a. Order parameter 

Let us first determine the order parameter of the transition, that is to say the fraction of variables with diverging 
minimal rearrangement sizes. This is defined as (f) — lim„_*oo Qn = 1 ^ ./(I)- Similarly, let (p = lim„^oo Qn = 1 ~ /(I)- 
From Eq. H40|l one obtains (j> = <j>^^^, whereas Eq. I|('8p evaluated at a: = 1 leads to 

(/) = 1 - cxp[-pa<j>P-^] . (C9) 

This has a non vanishing solution only for a > a^, where ad is the critical point defined in Eq. H17|l . The critical 
point and the value of the order parameter at this point can be determined by the two equations 

0d = 1 - cxp[-pad(?!>d"^] , (CIO) 
1 = adp{p - 1)<I>^^^ exp[-pa^(l)^~^] . (Cll) 

The last of these equations expresses the fact that the two functions of (j) on the left and right hand sides of Eq. (|C9|I 
become tangent at (f>d when a = ad. 



b. Critical decay 



We shall first place ourselves right at the transition, a = ad, and study the decay of Qn towards its asympotic 
value 0d. Define e„ = Q^ — 0d and e„ — Q„ — 4>d- The generating functions are given by 

/(a;) = 1 - 0d - ^ gf [e„] (x) , (C12) 

X 

and a similar expression for f{x). In terms of these quantities, Eq. (|40|l becomes e„ — {(fid + Cn)^^^ ~ 't'd- 

Guided by the numerical solution of Eqs. I|39() . H40|l we look for an asymptotic behavior of the form e„ ~ An~"' 
as n ^ oo. Here a is a positive exponent and A a constant. Equivalently qn — Aan^"^^. Expanding the relation 
between e„ and e„, we obtain 

in = ip- iWd-'^n + 2 ^ ^^'"^ ■ ^^^^^ 

Our aim is now to determine the decay exponent a, by matching the singularities around a; = 1 in the equation on 
the generating functions. 

Using Eq. (jC7p . we obtain gf[e„](l — s) ~ j4r(l — a)s~^+" as s ^ 0. Assuming < a < 1/2, we apply the same 
formula to /: 

f{l-s) = gf [e„](l - s) , (C14) 

1 — s 



f{i-s) ^ i-0,--_(p_i)<^^-gf[,„](i_s)-^r 2 ]€''&n<]i^-s) ■ (C15) 
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We can now plug these formulae in Eq. IIC8|l . and match the two sides order by order as s ^ 0. The terms of order 
are equal thanks to the equation IjClOl) on the order parameter. The terms proportional to sgf[e„](l — s) (of order 

s°) match because of Eq. I)C11|I . Next, on the r.h.s. of Eq. (|C8|I two terms of order appear (while none is present 

on the l.h.s.): one is proportional to sgf[e,^J(l — s), and the other to gf[e„]^(l — s). Requiring them to cancel yields 

the relation (|41|l which fixes the exponent a. 

The l.h.s. of Eq. (|41(l is shown in Fig.El As long as A G (0, 1], the equation has a unique solution in [0, 1/2). The 

exponent a is given by this solution, thus verifying the hypothesis a < 1/2. It order to show that A < 1 for any p, we 

use Eq. (|C11|I to simplify the expression for A: 

A=(p-2)1-^. (C16) 

Using the inequality > 1 + a; in Eq. (|C10|I . we obtain adpip^ '^ > 1- Thanks to HC11() we get (p — 1)(1 — (pd) < 1, 
which in turns implies the thesis. 



c. Intermediate regime 



We shall now study the behaviour of the probability law of the minimal rearrangements sizes slightly below the 
critical connectivity, i.e. as <5 — > 0. 

Inspired by the distribution of zero-temperature point-to-set correlation lengths, studied in Sec. lIII Bl we guess that 
an intermediate scaling regime emerges when Qn = (j)d + 0{S^^^). Using the results of the previous Section, we expect 
this to happen on a scale no{S) ~ (5"^/^°. For the time being, we only assume that no((5) diverges at S = more 
rapidly than S~^. 

In order to blow up Qn around its plateau, we define, for any t > 

eit) = lim S~'^^[Qn=tno - M , (C17) 

(5— >0 

and similarly e{t). Using Eq. (|40|1 . wc get 

In order to describe the plateau regime, we must properly rescale the generating functions as (5 ^ 0: 

/(I - y/no) - 1 - </.d - S'/^y L[e]{y) + o{S) , (C19) 

/(I - y/no) = 1 - 0, - S'/'{p l)0r'y l-H(y) - '^(^ 2 ^' '^ ""^''^^^^ ~^ 



(C20) 



In order to estimate the remainders, we assumed that e{t) is smooth for t > and has a singularity at t = which is 
milder than t~^/^. 

We can plug these formulae for /( • ) and /( • ), into Eq. HC8() and compare the two sides order by order in S. The 
terms of order and S^^^ match because of Eqs. (|C10|I and (jClip . On the contrary the order S determines the 
function e{t) via 



\l[e']{y) = - + y{L[e]{y)f , (C21) 

y 



where B = 2/{a'^p{p— l)^(/'j and A has been defined above. Inverse Laplace transforming the equation yields to 

d /■* 

A e{tf = B + — e{u) e{t - u) du . (C22) 



dt _ 

From this equation one can determine the asymptotics of e(t), which turn out to be: 

e{t) - , e{t) - t'' , (C23) 



where a is the exponent already found in the previous Section, and b is the positive solution of Eq. I|43|l . 

This allows us to fix the scale uq. Consider indeed large (but independent of S) values of n, and the limit 5^0. 
From the study of the previous Section at a = ad, we know that e„ n^°' . From the behavior of e(t) we have 

^ <5"'^/^e(n/no) ~ (5^/^(n/no)~°. Consistency in the limit (5^0 implies thus no ^ (5^^/^", confirming the qualitative 
argument given in the beginning of this Section. 

In Fig. 1241 we use the numerically determined distribution Qn in order to check the scaling form used in this Section. 
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e(i) 




FIG. 24: The scaling function of the intermediate regime, e{t), as defined in Eq. (IC17II . The datas used are at a 
0.816, 0.817, 0.818, and are almost superimposed. 




FIG. 25: The scaling function of the final regime, Q{t), as defined in Eq. 1C25II . The datas used are at a = 
0.812,0.816,0.817,0.818. 

d. Final regime 

At what size scale Uq^S) does Qn exit the plateau regime and decreases by a finite amount below 0d? Using the 
intermediate regime scaling, we have Qn' — (/)d — '^"^''^e(^^o/"o) = 0(1). From the behaviour of e{t) at large t, we get 
71q(5) ^ S^", where 

In order to describe this regime, we define the scaling limits 



Tpiy) = lim /(I - y/n'g) 



(C25) 



and analogous ones for Qn and f{x) (with scaling functions Q{t) and ijj{y))- As usual, the scaling limits of generating 
functions are related to Laplace transforms: ip{y) = I — yL[Q]{y), iil;{y) = 1 — yL[Q]{y). Equations l|in|l and (|C8p 
imply 



Q{t) = Q{t)P 1 , ^{y) = exp[-pad +pad^(y)] • 



(C26) 



This set of equations determines Q{t), the scaling function of the decay of Qn between 0d and (this function was 
denoted as Qs\ow{t) in Sec. lVC!)l . In particular they imply Q{t) ~t^o — est t^. This behavior can be matched with 
the intermediate regime, cf. previous Section, and can be used to confirm that tiq^S) ~ S~'^ . 

In Fig. |2Slwe check the scaling form used in this Section against the numerical solution of Eqs. (|39|) . H4U|) . 



e. Extreme decay 



What is the probability of an "anomalous" minimal size rearrangement, i.e. a site i such that is much larger 
than for most of the other sites? This question can be answered by studying the n — s- cx) asymptotics of the sizes 
distribution Qn- 
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It is convenient to consider first a slightly modified model, in which the maximum allowed variable degree /max is 
a finite number as — *■ c». We refer to |2q for graph ensembles of this type. It is easy to generalize our treatment 
to such graphs: Eq. l|in)l remains unchanged, while Eq. I)C8|I is modified to 

'max 

f{x)=xY,pif{xy-K (C27) 

1=1 

Here pi is the probability that an edge chosen uniformly at random in the factor graph J-' is adjacent to a variable 
node of degree I. 

A numerical investigation of Eqs. H4U|) and (|C27|1 suggests the Ansatz 

Q„ = cxp { n^+' +o{n^+')} , (C28) 

with z > 0. Equation H40() implies Q„ — exp{ — (p— l)ajn^+^ +o(n^+^)}. The corresponding generating functions 
can be estimated through the saddle point method. We get 

fix)^e^pi^zcj-'/^(^^y +o((logx)^)| , (C29) 

as a; — > oo. The analogous expression for f{x) is obtained replacing w by (p — l)w in the last formula. Inserting into 
Eq. ljC27|) and matching the leading term as a; — > oo determines the exponent z 

~- (C30) 



l0g(/,nax - 1) 



In other words, the probability of very large rearrangements decreases faster than exponentially. In a given graph Q 
of size N, the largest minimal size rearrangement rimax can be estimated by setting NQ„„^,^^ = 0(1), which implies 

"max- (logiV)TTr. (C31) 

Let us now reconsider the original model, with unbounded degree. The expression itCanll yields z ^ 0. A more 
careful study shows that 

Qn = exp { -n e'= } , (C32) 

where ip{n) is a function diverging as n ^ oo, but more slowly than any iterated logarithm^^ (i.e., for instance, than 
log log log n), and is a positive constant. 

2. Minimal barrier rearrangements 

We present in this Appendix the resolution of Eqs. (|56|l on the distribution of minimal barriers. We shall first 
discuss a more general class of distributional equations. The representation developed in this context is then used to 
solve numerically Eqs. H56() . Finally, we analyze the critical behavior of its solution. 

a. Transformation of the permutation functional 

Equations (|56|l involve functionals of the probability distribution q which can be generalized to the following 
problem. Consider I integers (fixed) yi, . . . , that without loss of generality we assume to be ordered, j/i < ■ • • < j/i, 
and define a function fi of I other integers by 

fi{bi, . . . ,bi) = min max [b^u-) + yt] , (C33) 
T ie[i,j] 



More precisely, it is a solution of tlie Abel equation '69l •fi{n) = ip(\ogn) + 1. 
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where the minimum is over the permutations tt of [1, 1]. Assume the 6i's to be i.i.d. random variables with distribution 
q. What is the distribution of . . . , 5/) ? Its cumulative distribution is 

1 - = E • ■ • KMh, ■■■M)>h), (C34) 
bl,. 

which is a functional of the law q. 

A first simplification is that the minimum in the definition of /; is achieved for a permutation ttq which orders the 
hiS by their value (and any such permutation is equivalent). In other words Xi = &7ro(i) with xi> ■ ■ ■ > xi. Now one 
has 



\xi+yi\>h] = 1 - I ( max [x^+y^\<b] =1-17 ^i^^ + < b) 
1 / V»e[i,i] J ^t=i 



...,bi)>b)=l (^max [x. +y^]>b] = l-l{ max [x, +y^]<b]=l-\\ l{x, + y, < b) . (C35) 

It is useful to represent the y^'s in a slightly different form. Let us call /' G [1,/] the number of distinct elements 
in the set {yi, ...,?//}, and y[ < ■ ■ ■ < y[, their values. The degeneracies of the y' are encoded in the coefficients dj 
defined for j g [1, V] as the number of yi strictly smaller than y'^ By definition one has = c?i < • • • < dp < L As 
an example, if for I = 6, (yi, . . . , y^) = (3, 3, 5, 6, 6, 8), one obtains /' = 4, (yj, . . . , y'^ = (3, 5, 6, 8) and (di, . . . , ^4) = 
(0, 2, 3, 5). These definitions can be used to remove the redundant constraints of Eq. (|C35|I : if for instance yi = j/i+i, 
Xi + yi < b ^ Xi+i + j/i+i < 6 as the Xi's are decreasing. These eliminations lead to 

/' 

HMbi, ■■■,bi)>b) = l-Y[ l{xd,+i + y] < b) . (C36) 

We now come back to the original variables b and define rrij, for j G [1, Z'], as the number of biS strictly smaller than 
b — y'y This imply that 

a;i > • • • > xi^,n. >b-y'j> a;;_,„^+i >--->xi . (C37) 

We thus have Xd^+i + y'j < b 4^ rrij > I — dj. We can now insert Eq. (|C36p in the definition ljC34|) and trade the sum 
on the bi against a sum on the nij respecting the above derived constraints. 



F. 



(0 



n 



The combinatorial factor arises from the change of variables from the Vs to the m's, and the constrained sum is over 

Z = mi > • • • > m// , mj>l-dj Vj G [1, . (C39) 

In the following, we shall repeatedly use the representation of F^''^ provided by (|C38|I . (|C39|I . 

Before leaving this general preliminary, let us note that if the biS are bounded from below by femin (i-e. (jb = for 

b < 6min), . . . , bl) is bounded from below by 6min + yi, hence F^^'^ = for 6 < fo,„in + yi- 



b. Application to the p-spin model and numerical resolution 

The equations H56|l . determining the barrier distribution of the p-spin model iQ), can be rewritten as 

00 

Qb = Y.Ml- FP[{q}]) , Q, = Ql^' , (C40) 

where is of the general form studied in the previous pages, with the 6,;'s drawn with the law g, and the j/^'s given 
by yi = [|J . Here we set by convention FjJ"' = 1(6 > 2). 

Following the notations of the previous Section, one has for a given value of /: /' = [^J + 1, = i — 1, di = and 
dj = 2j — 3 for 2 < j < I'. As the law q is supported on the positive integers, = for 6 < I'. This allows to 
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rewrite the equation (jC40|l under the form 



26-3 



l-Qb = po > 2) + (1 - Qb) + 1(6 > 3) ^ [{<?}] , (C41) 

/=2 




Fi>\m - E' TTW^TT r I TT Cr^"^ I (1 - (C42) 



with the constraints on the sum in Pj^^^: 

l^mi>---> mL,/2j+i , mj>l + 3- 2j Vj G [2, [Z/2J + 1] . (C43) 

These equations ahow to determine the distribution of messages Vi^a, Ua~^i defined in Sec. IVI CI fanchored barriers). 
The distribution of actual barriers to flip a spin in the system can be expressed in a similar way, 

26-2 

1 - Qt° = Po Kb > 1) - Qt) +1(6 > 2) E PiGb^U}] , (C44) 

1=2 



rv2i-i 

G^^'im = nrV2l-V ^ ^ n 'Z;™(l-^^-R/2Hl^^-^ (C45) 



with the constraints on the sum in G'l,''' : 

/ = mi > • • • > TO|-,/2] , mj>l + 2-2j Vj G [2, . (C46) 

(2) 

By convention the products from j = 1 to j = which appear in Gl are equal to 1. 

Unlike for the minimal size distribution, Eqs. (|C40p do not provide immediately an algorithm for computing Q by 
recursion over b. The reason is that the anchored barrier of a rooted tree is at least as large, but not necessarily 
larger, than the anchored barriers of its sub-trees. Consider now the process of merging I sub-trees (this corresponds 
to iterating (|C40p once). If sub-trees barrier distribution are known only up to barrier height 6—1, the barrier 
distribution of the new, larger tree is necessarily undetermined at height b. 

We can propose two ways to solve this difficulty. The first one is to derive a well-behaved recursion on 6. Assume 
that Q and Q (resp. q and q) are known upto height 6—1 (resp. 6 — 2). The only unkwnown of the right hand side 
of Eq. ljC41|l is Qb-i, which appears linearly because of the conditions mi = l,m2 > Z — 1 in the sum ljC42p . We can 
thus write 

1 - Qfc = A (76-1 + ^6 , (C47) 

where the coefficients Ab and Bi, are computable from qi,.. . ,qb-2 using Eq. (jC42|l . Using qt-i — Qb-i — Qb, and 
Qb ~ Qb~^^ 01^6 ends up with 

1-Qb + AQr' = ^ Qb-i + Bb . (C48) 

One can solve this equation for Qb (recall that Qb-i is assumed to be known at this stage) and therefore determine 
96-1 1 Qb — Qb~^ ^^'^ 96-1 ■ This allows to continue the recurrence at the next barrier height. 

The second method is iterative: make an initial guess for the law Q, compute the law Qb = Ql^^ , cf. Eq. (|C40|I . 
and inject it in (|C4ip to recompute Q. Any fixed point of this procedure corresponds to a solution of Eqs. (jC40|l . 
Since the solution is unique, whenever the procedure converges, it provides a good numerical approximation of this 
solution. It can be argued^^ that the iterative procedure indeed converges for any a < ad, if the initial condition 
Qb^ = 1(6 < 1) is used. 



A complete proof is beyond the scope of this Appendix. The basic idea is that the function ' obtained after £ iterations, is the 
minimal barrier distribution for a subgraph of radius £ around a random node i. Convergence follows from the remark that this barriers 
become larger (and therefore Q^*' worsen, in a sense that can be made precise) as £ increases. 
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Asymptotics 



In this Appendix we work out the asymptotic behavior of minimal barrier distributions, cf. Sec. I VI El Motivated by 
the resuhs on minimal size rearrangements, cf. Sec. IC ll we look for a plateau at Qi, w Qb ~ 4>d- We thus define 



Qb 



Od + fib , 



Qb 



£b 



(C49) 



With this definition one can set up an expansion of the functionals i^^^'-* in powers of e. We shall need in the following 
this expansion upto terms of order e^. Four types of terms appear at this order in Eq. HC42|) : 

• TOi :=••• = m[;/2j+i = ^ which gives a term of order 1. 

• TOi = TTig — /, TOs+i = • • • = m^(/2j+i — I ^ ^^ witli 1 < s < [l/2\ + 1, of Order e. 

• mi = • • • = ms ~ I, rus+i = ■ ■ ■ = m^i/2\+i =1 — 2, with 2 < s < \ l/2\ + 1, of order e^. 

• nil = ■ ■ ■ = TUs = I, nig^i = • • • = nit = ^ ^ Ij nit+i = ■ ■ ■ = TO[;/2J+i =1^2, with 1 < s < ^ < ll/2\ + 1, of 
order e^. 

Summing this terms and expanding the result upto order e^, we obtain: 



Fi') = (1 - 0d)' - Kl - M'-'et + i^^j (1 - 0d)'-'[2ebeVi - e'Li] + O(e') • 
Inserting this expansion in Eq. l|C4ip , assuming b > 3 (we are interested in the large b behavior) leads to 



(C50) 



£b 



26-3 



1=0 



26-3 



(-1 



1=0 



£6- 



'26-3 

E 

. i=0 



i-2 



[2466- 



■=6-1. 



+ 0(e^). (C51) 



Since we are interested in the large b behavior, we can extend the sum on I upto infinity with a negligible error^'^. 
Moreover we can expand the first equation in IIC40|) to express ei, in terms of et,. Ordering the different powers of e, 
we get 



1 



£6 



ap{p - 



p-2 -apipd 



1 



(2e6e6_ 



^6-1 



) = 0(e3). (C52) 



We now consider the critical limit 5^0 infinitesimal. The two terms in brackets vanishes at (5 = 0, because of 
Eqs. HC10|I and (jClljl . Expanding also in powers of 5, we obtain 



(C53) 

where B and A are as defined in Add. IC ll cf., for instance, Eq. (jC21|l . 

Notice that Eq. ljC53p is simpler than the analogous equation for minimal size rearrangements, i.e. Eq. (jC21|l . 
In particular, it is not necessary to introduce generating functions or Laplace transforms: Eq. (jC53p is local in the 
"direct space" of barriers. 

Let us consider first the large b behavior at the critical point ad- The left hand side of (|C53|I vanishes (as well as all 
corrections proportional to 5), and one can look for a solution such that eb ^ e^'^"^ as 6 — > oo. Injecting this Ansatz 
in Eq. (|C53p and requiring the terms of order e"^'^"'' to cancel yields the condition A — 2e'^'' + e^"^" = 0, which fixes 
LUa, as announced in Eq. ()58|l . 



More precisely, we shall eventually focus on fe = 0{ log{l/5)), and retain terms in this equation up to 0((5). On the other hand, extending 
the sums up to / = oo produces errors of order 1/6! = exp(— felogft) = (log ( 1/(5) ) * <C 5 (to the leading exponential order). 
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In order for Eq. (jCSSjl to have a non-trivial limit within the plateau regime, we must have = 0d + 0{5'^/'^) 
in this regime. We therefore assume the existence of a diverging scale = bQ{5), and define ~ 5^'^^'^^b=m+ba- 
Substituting in Eq. l)C53p and taking the (5^0 limit, we get 

B ^ A4 - 2e„,e„„i + 4_i . (C54) 

It is easy to work out the asymptotic behavior of the solution of this equation. We get — C-e"""™ as m — > — oo, 
and em — — C+e"''™ as to +00, where Wf, is given by Eq. H6()|l and C± are two positive constants. 

The scale fep is fixed by matching the behaviour of e;, at ad for b ~* 00 with the one of when m — » — cx3. Consider 
a large (but independent of 6) value of b, and the limit a ^ a^'- 

e, ^ e-""^ ~ 6^/^em=b-bo - S^/^e^^'^'e-^^'' . (C55) 

The dependence on 5 cancels only if 6o(<5) ~ log(l/5)/(2ti;a). In Fig. 1261 left frame, we plot the outcome of a numerical 
resolution of the equations (|C40p along the lines exposed in the previous Section. The data are rescaled in such a way 
to exhibit the plateau scaling. More precisely, we plot 

6-^^^[Qb'4>d], (C56) 

for several values of 6, as a function oi m = b — \og{l/d)/{2uja)- The good collapse of the curves confirm the analysis 
just presented. 

Notice that the quantity ljC56l) is not expected to converge to a unique curve as a function of to, even if bo{6) is 
chosen optimally (here we just derived its asymptotic behavior). In other words, Cm is not a scaling function in the 
usual sense. The reason is that Eq. lfC54|l has more than one solution, and two such solutions e'-"'^) and e^^^ cannot be 
superimposed through a shift of the to axis (this is related to the fact that to is discrete). On the other hand, a shift 

can be found such that < e™^ < e^^+i- Therefore the function (jC56p will converge, as a function of to = b — ba{5), 
within a 0(1) distance around any solution of Eq. 1C54() . This is enough for the analysis presented in this pages to 
be valid. 

Finally, the scale b'^iS) for the decrease of Qh from 0d to 0, can be defined as the smallest b such that Qf, < with 
Q* any fixed number smaller than 0d- It can be estimated by requiring ef, to be of order 1, or, equivalently, tb to be 
of order 5''^/'^. This implies ef,^_6„ - 6-^/"^, i.e. e^'^^'o"'"') - 5''^/'^, hence 

b',{5) ^ bo{5) + ^ log(l/<5) ^ (^-i- + iog(l/5) , (C57) 

as announced in Eq. H61() . 

Figure right frame, shows Qh (obtained from the numerical resolution of Eqs. HC40() '). as a function of to' = 
b — fco(5). The curves for different values of 5 collapse between and 0d, thus confirming our analysis. 

Contrary to the minimal size case, one cannot define a scaling function for the last decay from the plateau value to 
0. Indeed, this happens on an interval of b which remains of order 1 when 5-^0. This means that a finite fraction of 
the barriers is not just of order 6q((5), but within a finite additive constant from 6q((5). 

This asymptotic study has been performed on the distributions Q and Q of the messages on the links of the factor 
graph (anchored barriers). However, actual barriers to spin flips differ at most by one from anchored barriers. The 
discussion presented so far is thus also valid for the actual barrier distribution 



3. Average size of minimal barrier rearrangement 

Let us explain how to derive the results presented in Sec. lVIl'XI on the average size of minimal barrier rearrangements. 
To this aim one has to solve Eqs. (|73|l and H74|) . The first of these equations involves a constrained sum on / anchored 
barriers &i, . . . , 6;, whose disjoint combination /;(&i, . . . , 5;) leads to a prescribed barrier b. This is similar to Eq. I|5t)|) 
(first equation) that was solved in App. IC 2l Unlike in Eq. (|56|l . one of the I barriers is not drawn from the distribution 
q, but is the argument of the unknown sequence M . Let us define an integrated version of this sequence (as well as 
of the related M), 



b'<b b'<b 



(C58) 
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5-6' 



FIG. 26: Left: the scaling function em for the minimal barrier rearrangements. Right: collapse on the scale of exit from the 
plateau. 



Notice that, at odds with our usual conventions we integrated to the left. Equation H73II can thus be rewritten as 



2b-3 



Nb = l-Qb+ J2p^^^i 



(0 

b ' 



N, 



(0 



J2 Mb,qb,...qb,lifl{bi,...,bi) <b) 



(C59) 



The sum in iV^ can be transformed following the strategy exposed in App. IC 21 treating the distinguished indice bi 
separately from the others. A similar reasoning leads indeed to 



N, 



(0 



(/-I)! 




"ii-'"j+i jQ™j-™j+i 

: b-j 



(l-Qb-LV2jrL'^=J+^(^b-LV2jrL'/^J+^ - (C60) 



where the parameters of the sum obey the following constraints: 

l-l = mi> ■■■> mL;/2j+i , 1 = m'l > • • • > m[;/2j+i , rrij + m'^ > I + 3 - 2j Vj € [2, [l/2\ + 1] . (C61) 

We have encoded the value of the special indice bi in the sequence of the m'j, with = 1 6i < b — j + 1. The 
form (|C60|) is suitable for numerical resolution of Eqs. H73II . 174|1 . following one of the two strategies (recursion or 
functional iteration) explained in Sec. IC 2 bl 

Let us now study the asymptotic regime a ^ a^- Following the notations of Add. [U2l we can expand Eq. ljC60|) 
in powers of h ~ Qb ~ (pd- 



N, 



(1 - M-'m + (/-!)(!- <^d)'"1^6-i(eVi - h) - Nbh-i] + O(e^) 



(C62) 



Inserting this expansion in Eq. (|C59p . and extending the sum on / to infinity (as in Sec. lC 2 cl this produces a negligible 
error) leads to 



iVfa = 1 - 0d - £6 + ape-"P^^ A^, + (ap)2e-"P"*^ [Nb-iieb^i - it) - Nbib^i] + 0(6^) 
Expanding also Eq. (|74|l to the same order yields 

Mb = Mb{p-lW^-^ 



p- 2 , 

l + ^TT— (eb + efc+i) 
2(pd 



O(Me^) . 



(C63) 



(C64) 



Next we take finite differences of Eq. HC63() and trade N for A, thanks to HC64() . and e for e, thanks to Eq. iBUll . We 
finally get 

[l~p{p - l)a(/.r'e-P"'^^](A^b+i - Nb) = ^p{p - l){p - 2)a0r'e~P"^^(^6+i - Nb){eb + et+i)- 

-p\p- ifa'^^l^-^e-P"'^^ [Nb+icb + Nbieb+i - eb - eb-i) + ^f,-i(ef,-i - efa)] + 0(1, A^e') • (C65) 
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FIG. 27: The intermediate regime scaling function for the study of the size of minimal barrier rearrangements. The two solid 
straight lines have the slope of the asymptotic behaviours, A'^^, ~ e'^"/'''" when m ±cx3. 



As usual, we consider three distinct asymptotic regimes. Let us begin by assuming a — ad and b large. The 
l.h.s. of Eq. (|C65|I vanishes because of Eq. (jClip . Moreover, we know from Add. IC 2cl that Cb ~ e~""^. Numerical 
computations suggest the Ansatz Ni, ~ e^"'', with /i^ > (jj^ > 0. Under this Ansatz terms of order 1 and Ne^ can be 
safely neglected in Eq. I|C65|I . Requiring the r.h.s. to vanish to the leading order g^^"^'^")^, yields the condition 

(eM. - l)(e-^a + 1) - 2 ■ ^^^''> 

It is not hard to show that the above equation admits a unique solution larger than uja, thus completely determining 
the exponent fia- For instance when p = 3 one obtains fia ~ 0.81650 > LUa ~ 0.57432. 

Consider now the intermediate regime, (5 — > 0, with b — m + bgi^S), where 6q(5) ~ \og{l/6)/{2uja) and m is finite. 
We found in this regimG ci sc&ling function 6771, such, that ci, — 6 ' ^rn- 

Let us introduce now a similar scaling function 
for the iVb's, Ni, ~ 5~^Nm, with x a still unknown exponent that we assume to be larger than 1/2. With this 
assumption, the dominant terms in Eq. (|C65p are of order 5"^+^/^. Imposing Eq. ljC65|l to hold at this order, we 
obtain the following equation for the scaling function Nm: 

Nm+l^m + NmCSm+l ~ Cm ~ Cm-l) + A^m-l(e)ri-l ^ Erjj.) = -^(A^m+l — A^m)(em+1 + fm) • (C67) 

We found in Add. IC 2"cl that Im ~ e"'^°™ (resp. Im ^ e'^''™) in the m — > — oo (resp. +00) limit. Using these results, 
one can derive the asymptotic behaviour of Nm in these two limits. When m —00, we have Nm ^ e^°™, where fia 
is the exponent previously determined. When m — > +00, 7V„j ^ g^''™, where /if, is the unique positive solution of 

(e^o - l)(e"<' + 1) ~2" ^ ' 

For instance, we obtain fib « 3.90350 for p = 3. 

The exponent x is obtained by matching the limit 6 ^ 00 of the a — solution, and the limit m s- —00 of the 
intermediate regime: 

Nb - e''-'' - S-^e''"^''-'"''' = e''"''J-^+^ . (C69) 

For the dependence on S to cancel, we have to take x — fia/i'iuja). Note that the assumption x > 1/2 is a posteriori 
confirmed, as fia > Wa- 

This analysis of the intermediate regime is confirmed by Fig.|23 Here we plot 5^Nb, versus m — 6 — log(l/(5)/(2ti;a), 
with Nb computed numerically for several values of S, and x determined analytically as explained above. 

Finally, we look for the asymptotic behavior of Nb when b ^ &o(^) the typical height of large minimal barriers 
(recall that &o(^) — ""^ log(l/'^))- From the behaviour of N^ when m +00, we get 

Nb ~ d-^e^^^'o-'"^ ~ r-^-" , ^.barr = ^ + ^ ■ (C70) 

2uJa 2uJb 

As qb is of order 1 in this regime, the exponent t'barr is indeed the one which controls the divergence of Mb/qb, the 
average size of large scale minimal barrier rearrangements. 
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4. Average distance in minimal sizes rearrangements 

We study in this Appendix the asymptotic behaviour of the solution r„ of Eqs. (|85() . This allows to compute the 
average radius of minimal size rearrangements. Let us denote g{x) and g{x) the g.f.'s associated repectively to r„ 
and T„. The first of equations l|85|l can be rewritten as 

g{x) =paf{x)g{x) , (C71) 

where / is the g.f. of the QnS. 

Consider first the solution at a — ad- From the results of Sec. I(] ll we have the following asymptotic behaviors as 
n ^ oo (s ^ 0): 

/(I -s) = 1 - (Ad - AT{1 - a)s" + o(s") , (C72) 

- - (P - l)0r' + Mp - - 2)cf>P~'n-'^ + o{n-'^) , (C73) 

nqn = Aa{p ~ + o(n-'^) . (C74) 

Motivated by the numerical solution of Eqs. H85|l. we assume that, when a = ad, T„ admits a finite limit Too as 
n oo. This implies 17(1 — s) = TooS"^ + o(s~^) as s ^ 0. Using the second of equations H85|) . together with the 
formulae (EZS)), ^7^, we get 

.9(1 - s) = (p - 1)0^' .9(1 - =s) + ^r(l - a){p - l)0r'((P - 2)^00 + a0d)s'^-' + . (C75) 

Plugging this Ansatz in Eq. I|('71(l along with the expansion (|('72p . one realizes that terms of the type est • g{l — s) 
(with est an s- independent constant) cancel because of Eq. (|C11|1 . The leading surviving terms are of order s^^^"". 
Imposing them to vanish, we get 

Too = '-^j^ . (C76) 

Let us now turn to the intermediate regime, on the scale no((5) = S~^^'^'^, and define the scaling variable t ~ n/no{S). 
We found in Sec. lC 1 ci that 

fix^l- y/no) = 1 - 0d - (51/2 L[^](y) ^ ^(^i/2) ^ (C77) 
^ = ip-l)rd-' + ip-l)ip-m-'S'^\{t)+o{5'/') , (C78) 
^{p-l)cl,P-^S'/'te'(t)+o{6'^') , (C79) 



nq„ 



where e{t) is the scaling function of Qn around the plateau, introduced in Eq. ljC17|l . 
Let us make the following Ansatz on this scale: 

T„ ~ F{t = n/no) , ~ F{t - n/no) . (C80) 

In this regime, the second of equations (|85|l reads 

f„ = (p - l)(^P-'Tn + 6'/\p - l)0r'((?' - 2)F(t)e(t) - 0dte'(i)) + o(^^/') . (C81) 

Next we insert this formula in Eq. ljC71|) and expand in S. Leading order terms are of the form est • T„ (of order (5"), 
and cancel as usual. The scaling function F{t) is is determined by the vanishing of 0{S^^^) terms, which leads to 

yL[e]{y) L[F]{y) - XL[eF]{y) = ~{1 - ^ \-[te']iy) . (C82) 

Studying the limit y ^ 00 of this equation, one can check that F{t) reaches for small t the value Too determined above, 
fulfilling the consistency condition between the end of the finite n regime and the beginning of the "intermediate" 
one. Consider now the limit t — > 00, and assume F{t) ^ , with x a yet unknown positive exponent. Recalling that 
e(i) ~ i'' as t — > CX3, the above equation yields: 

m+xni+b) 
m+x + b) - ^ ■ 
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It follows from the convexity of logr(l + for x > that this equation has a unique positive solution, which, because 
of Eq. (gSl, is a; = 6. 

Finally, let us turn to the large rearrangements regime, n = tn'Q{S), with no((5) ^ 5~'^ . We define scaling functions 
on this last scale by 

r„ ~ S-'^Git = n/n'o) , f„ ~ 5-^G{t = n/n'^) . (C84) 

We defined in App. IC 1 dl the scaling function Q{t) for the minimal size distribution Qn in this regime. From this 
definition, we have 

/•OO 

fix^l- y/n'o) ~ V(y) = 1 - y / Q{t)e-y' dt , (C85) 

JQ 

^ {p~l)Q{tr-' , (C86) 
nqn ^ -{p-l)tQ'{t)Q{t)P-^ . (C87) 

These last two formulae allow to relate G{t) and G{t), using the second of equations H85|) . Assuming C > (which is 
consistent with the outcome of numerical computations), we get 

G{t)^{p~l)Q{t)P-^G{t) . (C88) 

Injecting this expression in Eq. (jC7ip . we finally obtain an equation determining the scaling function G(t), 

L[G]{y)=p{p-l)a^i:{y)L[QP-^G]{y) . (C89) 

Using Eq. ljC26p . it is not hard to show that G{t) — —9^tQ'{t) is, for any 0, > 0, a solution of this equation. This 
solution yields G{t) ^ for t — > 0, consistently with the above study of the intermediate regime. 

A matching argument allows to fix the exponent C- Consider indeed n = tno(5), with t 3> 1 but independent of 
5. From the limit t ^ oo oi the intermediate regime we have T„ ~ . Consider instead the limit ^ — > of the final 
regime, we get 

T„ ~ 5-^ {tn^{5)ln'„{5)i' ^ . (C90) 

Matching the two asymptotics, we obtain the universal exponent Q — 1/2. 

Let us finally compute the quantity On = T'„/(ng„), i.e. the average radius of a rearrangement of size n. Using the 
above solution we find, on the scale of large minimal size rearrangements n ^ n'^i^)'- 

5. Geometrical susceptibility 

In this Appendix we work out the critical behavior of the geometrical susceptibility defined in Sec. IVIlO 

a. Minimal size rearrangements 

The susceptibility for minimal size rearrangements is determined by solving Eqs. H97|l . It is helpful to rewrite the 
first of these equations as 

n-l 

5„ = 1 - Q„ + (1 - Qn)Sn + 1m{Sn-m " 5„) . (C92) 

m=l 

As usual, we start by considering the large n behavior at a = ad. Numerical computations suggest the Ansatz 
Sn — 3^,71^ , with w > an exponent to be determined. From the second of Eqs. (|97l) . and recalling that Q„ = 
(^d + An~'^ + o{n~°-), we get 

Sn = p{p - l)a^cl)P-^Sn + p{p -l){p- 2)a^cj>P-^AS,n"'-'' + o{n^-'') . (C93) 
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FIG. 28: Critical scaling of the geometrical susceptibility for minimal size earrangements. Different curves refer to p = 3 and 
a = 0.7, 0.75, 0.78, 0.8, 0.81, 0.814, 0.816. Left: intermediate regime. The straigth lines correspond to the asymptotic behaviors 
(as t 0) and t'' (as t oo). Right: large scale rearrangements regime. 



This implies in particular Sn — p{p — ^)ctd4'd '^S^:n^. This expression can be substituted in Eq. (|C92|I . The leading 
terms are of the type est Sn (and of order n™) and cancel because of Eq. (|C11|I . We get an equation of the form 

= l-^d + AS-^C 71"'-'^ + 0(1,71"'-'^), (C94) 

where C is n-independent and given by 

n ( 1^ /\ r(l-a)r(l + w) l innr.\ 

and A is the constant already introduced in Sec. IV Cl Notice that Eq. ljC94(l cannot be satisfied for w < a (in this case, 
it would imply 0=1 — 4>d), nor for w > a (it can be shown^** that C < for w > Q). Therefore we have necessarily 
w = a, and Eq. ljC94|l determines the prefactor 5**. 

Next we consider the intermediate scale no(5) = 6^^/^°-. Since S'„ ~ at a = a^: we expect Sn ^ S^^^^ for a < 
and n ~ no{S). We assume the scaling behaviour 

5'„~n"^i?(t = n/no((5)), (C96) 

with an analogous Ansatz for Sn (with scaling function R{t)), and x > an exponent yet to be determined. Equations 
(EZI yield (cf. also the form (|U^ 1 

R{t) = p{p-l)a^cj,P-^R{t)+pip-l)ip-2)a^r-\{t)Rit)6'^'+o{S'^'), (C97) 

R{t) = (1 - 0d)(5" + (1 - (t>d)R{t) - e{t)R{t) (5^/2 _ f e'{s)[Rit - s) - R{t)] ds + o{S^/^) . (C98) 

Eliminating R(t), we obtain an equation determining the scaling function R(t). For a; = 1/2 we get: 

(1 - 0d)^ + (A - l)e(i)^W " / e'is)[R{t-s)~R{t)]ds^O. (C99) 

Jo 

Other values of x can be excluded via an analysis of the resulting equations: we shall stick to a; = 1/2 hereafter. 
The asymptotic behavior of the solution of Eq. (|C99|I can be determined by recalling that e{t) ~ t^°- as t ^ 0, and 

e{t) as t ^ 00. We get R{t) ~ t° for t ^ and R{t) - for t 00. The choice a; = 1/2 is confirmed by 

matching the t — > behavior with the analysis of the finite n regime, explained above. 

In Fig.|2Sl left frame, we plot S^^^Sn versus J^/^°n, with Sn determined via a numerical solution of Eqs. (|97|1 . The 
good collapse confirms the validity of the above analysis. 



Consider the expression in curly brackets in Eq. IC95I (the prefactor is positive). Proving that it is negative is equivalent to proving 
that Fa{l + w — a) > Fa{l — 2a), where Faix) = logr(x + a) — logr(a;). This in turns follows from the fact that logr(a;) is strictly 
convex for x > 0. 
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Let us finally consider the scale of large rearrangements n[^{5) = 5 , and assume in this regime 

Sn^^-^ S{t = n/no{5)), (ClOO) 

with an analogous Ansatz for Sm and 77 > a new critical exponent. Injecting this form in Eqs. H97|l . and recalling 
that Qn — Q{t — n/nQ{5)) on the same scale, we get: 

S{t) ^ {l-(Pd)S{t)~ f Q'{s)S{t- s)ds, (ClOl) 
"'0 

S{t) = p{p-l)adQ{tf-^S{t). (C102) 

Studying these equations in the t limit allows to determine the asymptotic behaviour S{t) ^ as t 0. 
This allows to determine the exponent 77 through a matching procedure. If we let n = tno{S), with t large but 
(5-independent, from our study, respectively, of the intermediate and final regimes, we get 

Sn ^ S-^/H'' ^ 5-" {tnoiS)/n'f^{S)f . (C103) 

This in turn implies r] = I. 

In Fig.[2Hl right frame, we check the scaling hypothesis in the final regime (as well as the exponent i] — 1) against 
a numerical solution of Eqs. 



b. Minimal barrier rearrangements 

This part of the Appendix is devoted to the resolution of Eqs. (|99I100|) for the geometric susceptibility of minimal 
barrier rearrangements. Using the fact that J^t = 0, Eq. H99|) can be rewritten as 

2b-4 

5b = 1 - Qb - ^ Si'^ = J2 h,qb,...qbMMbi,...,bi)<b) . (C104) 

1=0 bi,...,bi 

The quantity sj^''^ is very similar to Nj^''^ defined in Eq. (|C59|I . with the sequence Sb replacing AIi,. In particular S*^'^ 
admits a representation of the form (|C60|) . where Ni, is replaced by —Sb- The numerical computation of Sb proceeds 
along the lines exposed in Sec. IC3I 

The expansion of Eqs. (|99|l . (|100|l in powers of eb = Qb ~ (pd is also analogous to the one of Sec. IC 31 We get 

Sb = l-<^d-eb + e~"''^^"'^b + ap(p-l)0r'e""^'^'"'[5b-i(eb-i-eb)-^be6_i]+O(e25) ^ (C105) 
Sb = ap{p - iW-^Sb + ap{p - l){p - 2)^P^-\bSb + 0{e^S) . (C106) 

Next we eliminate Sb from the above equations and assume the asymptotic behavior Sb — S^e^^ , with w > to be 
determined. Recalling that ef, ~ Ae"'^"^, we get 

= (1 - 0d) + CS. e("'-'^")^ + 0(1, e("'-'^")^) , (C107) 

where 

C = p(p-l)ad0r'{^-[e"°-K"-l)e^"']} , (C108) 

and A is defined in Sec. IV CI Using an argument similar to the one in the previous Section, one can show that 
Eq. HC107|) implies w = Wq. 

Let us consider now the intermediate regime 6 = to + 6o('5)i where 6o('5) — log(l/(5)/(2a;£i) and tb ^ f^^^^em- Inserting 
the Ansatz Sb — S~^Sm in Eqs. I|C105|I . ljC106() . dominant terms (of order S^^) cancel. For next-to-leading terms to 
cancel, one has to choose x = 1/2. The scaling function Sm is then found to obey 

AS'mCm 4- Sm-li^m-l - ^m) - Sm'^m-1 + (1 ^ 4>df = . (C109) 

The asymptotic behaviour of Sm can be deduced from this equation, using the results on em, cf. Sec. K] 2^ One finds 
Sm ~ e'^"™ as m ^ — c» (thus matching the behavior in the first regime) and Sm ~ e'^'™ as m ^ oo. 



54 




FIG. 29: Scaling of the geometrical susceptibility for minimal barrier rearrangements. Different curves refer to p = 3 and 
a = 0.8, 0.81, 0.814, 0.816, 0.817, 0.8175, 0.818, 0.8182. Left: intermediate regime. The straigth lines correspond to the 
asymptotic behaviors e"""' (as m — > — oo) and e"''™ (as m — > oo). Right: large scale rearrangements regime. 



In Fig. 123 left frame, we compare the postulated scaling in the intermediate regime with a numerical solution of 

Eqs. (El, ((Tnn|i . 

Finally, on the large rearrangement scale b'f^{5) ^ T \og{\/5), we expect Sb ^ 5^^ ■ The exponent 77 can be determined 
by matching this behavior with the large m asymptotics in the intermediate scale: 

Sy^ ^ S-^^^S^^t'„-bo ~ S-^^^ exp jc^b^ log(l/<5)| . (CllO) 
We thus have 77 = 1 as claimed in Sec. IVII C 21 



APPENDIX D: LOW TEMPERATURE BEHAVIOR OF THE DYNAMICAL LINE 

In Sec lVIIll we claimed that the dynamical transition line behaves as described in Eq. (|103|l in the low temperature 
limit. A proof of this statement requires a particularly involved asymptotic calculation, and goes beyond the scope 
of this paper. On the other hand, a simple argument can be constructed as follows. 

Consider a > and expand the solution of the IRSB equations (|B14p . (|B15I) as T ~> 0, with a and m < 1 fixed. 
At T = 0, the order parameters Q(p), Q(/5) concentrate over local field distributions p{h), p{u) supported on integer 
fields h,u G Z. More precisely, p{u) — ^S{u — 1) + ^5{u + 1) with probability (p (corresponding to hyperedges in the 

backbone), and p{u) = S{u) with probability 1 — (hyperedges outside the backbone). Analogous expressions hold 
for Q{p). 

A small non-zero temperature has two effects on Q{p). First of all, any local field distribution p(u) in the support 
of Q aquires a peak for u « 0. Second, the peaks on integer fields acquire a small width. In general, this width is of 
order T and the last effect dominates. For XORSAT, the width is of order e~^^ and can be neglected to first order 
(this can be checked through usual population dynamics algorithms and yields indeed a consistent low T expansion) . 
Therefore, the leading correction is captured by the form p{u) « ^(1 — po)S{u — 1) + po^{u) + ^(1 — /5o)(5(m + 1). The 
distribution Q{p) is concentrated over p{u) of this form and is completely determined as 

^ _ I n2'"e~2/3'» with probabifity Q„, 

1 1 with probability 1 — </). 

The distribution Qn has normalization Qn = cj) , and satisfies the equations 

Qn — ^ ^ Qjii ' ' ' Qjip-i ^n— ni ^ip-i 5 (-^^) 

ni...r!p_i 

Qn = [i~Pa~Pl-P2]S„fl+P2SnS+PlQn- (D3) 

where pi — {pa(pye~P°"^ /II, and Q„ parametrizes the functional distribution Q{p). At any fixed a > a^, the leading 
correction to p{h), p{u) is of order e~^^™. Since m < 1, it is consistent to neglect the 0{e~'^^) width of the peaks on 
integer u's. 
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FIG. 30: Low temperature behavior of the dynamical transition line. Symbols (with error bars) correspond to a numerical 



determination of a^{f3) along the lines of Add. The line is a fit to the form ad(/3) = + 



-2/3 
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By studying Eqs. (|D2(I . I|D3|I as a J, ad, one can show that the typical scale of n diverges as {a — ad)~^. The 
above low-T expansion breaks down when po ^ (a — ad)^^e^^^™ = 0(1), i.e. for a = ad + 0{e~'^^"^). The DPT 
corresponds to a singularity in the solution of Eqs. IIB14|) . (|B15ll at m = 1 — . If we identify this singularity with the 
low-T expansion breakdown, we get the scaling (|103|l . 

The above argument does not fix the coefficient Xd- In order to determine it numerically (for p — 3), we computed 
ad{(3) numerically for several values of f3, and fitted the results to the form (|103|) . At each value of (3, ad was 
determined by computing the length (e) defined in Sec. IIII 51 using the method of Add. IB 3l and fitting the result 
using the form ^,(e) « A{ad{l3) — a)^^/^. The resulting critical points are reported in Fig. ISUl 

Next, the values for T < 0.32 were fitted using the form ad{f3) = ad + Xde~^^ + ydS-^^^ ■ This gives a very good 
description of the data if Xd — 11.76, and yd — 1378. The final result (with a somehow subjective estimate of the 
error) is 

Xd = 11.7(5). (D4) 

We conclude by stressing that, in general mean-field models on sparse graphs, the low-temperature behavior of the 
dynamical transition line can be different from Eq. H103|) . because of 0{T) cavity fields. 
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